2023-02-09 17:53:32,508 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-09 17:53:32,775 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457 2023-02-09 17:53:32,793 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-09 17:53:32,793 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0, deleteOnExit=true 2023-02-09 17:53:32,794 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 17:53:32,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/test.cache.data in system properties and HBase conf 2023-02-09 17:53:32,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 17:53:32,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/hadoop.log.dir in system properties and HBase conf 2023-02-09 17:53:32,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 17:53:32,797 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 17:53:32,797 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 17:53:32,919 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 17:53:33,321 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 17:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 17:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 17:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 17:53:33,326 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 17:53:33,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 17:53:33,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 17:53:33,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 17:53:33,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 17:53:33,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 17:53:33,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/nfs.dump.dir in system properties and HBase conf 2023-02-09 17:53:33,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/java.io.tmpdir in system properties and HBase conf 2023-02-09 17:53:33,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 17:53:33,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 17:53:33,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 17:53:33,897 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 17:53:33,902 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 17:53:34,196 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 17:53:34,386 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 17:53:34,402 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 17:53:34,441 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 17:53:34,477 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/java.io.tmpdir/Jetty_localhost_41679_hdfs____2sc2p1/webapp 2023-02-09 17:53:34,632 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41679 2023-02-09 17:53:34,670 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 17:53:34,671 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 17:53:35,181 WARN [Listener at localhost/41421] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 17:53:35,289 WARN [Listener at localhost/41421] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 17:53:35,309 WARN [Listener at localhost/41421] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 17:53:35,316 INFO [Listener at localhost/41421] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 17:53:35,321 INFO [Listener at localhost/41421] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/java.io.tmpdir/Jetty_localhost_46613_datanode____i4gdml/webapp 2023-02-09 17:53:35,416 INFO [Listener at localhost/41421] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46613 2023-02-09 17:53:35,707 WARN [Listener at localhost/44673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 17:53:36,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x115407d49cd6fdae: Processing first storage report for DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6 from datanode 83933e6b-e6c2-4b42-a43d-01ae705447a4 2023-02-09 17:53:36,124 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x115407d49cd6fdae: from storage DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6 node DatanodeRegistration(127.0.0.1:34373, datanodeUuid=83933e6b-e6c2-4b42-a43d-01ae705447a4, infoPort=40855, infoSecurePort=0, ipcPort=44673, storageInfo=lv=-57;cid=testClusterID;nsid=893448511;c=1675965213977), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-09 17:53:36,124 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x115407d49cd6fdae: Processing first storage report for DS-ef60694d-94f6-40e4-b0ee-1b0e3dcf5e2d from datanode 83933e6b-e6c2-4b42-a43d-01ae705447a4 2023-02-09 17:53:36,124 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x115407d49cd6fdae: from storage DS-ef60694d-94f6-40e4-b0ee-1b0e3dcf5e2d node DatanodeRegistration(127.0.0.1:34373, datanodeUuid=83933e6b-e6c2-4b42-a43d-01ae705447a4, infoPort=40855, infoSecurePort=0, ipcPort=44673, storageInfo=lv=-57;cid=testClusterID;nsid=893448511;c=1675965213977), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 17:53:36,209 DEBUG [Listener at localhost/44673] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457 2023-02-09 17:53:36,270 INFO [Listener at localhost/44673] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/zookeeper_0, clientPort=59572, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 17:53:36,284 INFO [Listener at localhost/44673] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59572 2023-02-09 17:53:36,291 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:36,293 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:36,953 INFO [Listener at localhost/44673] util.FSUtils(479): Created version file at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7 with version=8 2023-02-09 17:53:36,953 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/hbase-staging 2023-02-09 17:53:37,260 INFO [Listener at localhost/44673] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 17:53:37,706 INFO [Listener at localhost/44673] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-09 17:53:37,737 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:37,738 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:37,738 INFO [Listener at localhost/44673] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 17:53:37,738 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:37,738 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 17:53:37,874 INFO [Listener at localhost/44673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 17:53:37,943 DEBUG [Listener at localhost/44673] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 17:53:38,035 INFO [Listener at localhost/44673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37293 2023-02-09 17:53:38,045 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:38,047 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:38,067 INFO [Listener at localhost/44673] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37293 connecting to ZooKeeper ensemble=127.0.0.1:59572 2023-02-09 17:53:38,105 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:372930x0, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 17:53:38,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37293-0x1003a379fc60000 connected 2023-02-09 17:53:38,133 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 17:53:38,134 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 17:53:38,137 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 17:53:38,144 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37293 2023-02-09 17:53:38,145 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37293 2023-02-09 17:53:38,145 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37293 2023-02-09 17:53:38,145 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37293 2023-02-09 17:53:38,146 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37293 2023-02-09 17:53:38,151 INFO [Listener at localhost/44673] master.HMaster(439): hbase.rootdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7, hbase.cluster.distributed=false 2023-02-09 17:53:38,219 INFO [Listener at localhost/44673] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-09 17:53:38,219 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:38,219 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:38,219 INFO [Listener at localhost/44673] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 17:53:38,219 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 17:53:38,220 INFO [Listener at localhost/44673] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 17:53:38,224 INFO [Listener at localhost/44673] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 17:53:38,228 INFO [Listener at localhost/44673] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42581 2023-02-09 17:53:38,230 INFO [Listener at localhost/44673] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 17:53:38,236 DEBUG [Listener at localhost/44673] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 17:53:38,237 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:38,240 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:38,242 INFO [Listener at localhost/44673] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42581 connecting to ZooKeeper ensemble=127.0.0.1:59572 2023-02-09 17:53:38,246 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:425810x0, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 17:53:38,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42581-0x1003a379fc60001 connected 2023-02-09 17:53:38,247 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 17:53:38,248 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 17:53:38,249 DEBUG [Listener at localhost/44673] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 17:53:38,249 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-09 17:53:38,250 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42581 2023-02-09 17:53:38,250 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42581 2023-02-09 17:53:38,250 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-09 17:53:38,251 DEBUG [Listener at localhost/44673] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42581 2023-02-09 17:53:38,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:38,261 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 17:53:38,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:38,281 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 17:53:38,281 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 17:53:38,281 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:38,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 17:53:38,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37293,1675965217092 from backup master directory 2023-02-09 17:53:38,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 17:53:38,286 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:38,286 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 17:53:38,287 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 17:53:38,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:38,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 17:53:38,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 17:53:38,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/hbase.id with ID: f4fb2626-c547-4c96-8511-6d1e38fe1a93 2023-02-09 17:53:38,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:38,421 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:38,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06a13093 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:38,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0413c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:38,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 17:53:38,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 17:53:38,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 17:53:38,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 17:53:38,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 17:53:38,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 17:53:38,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 17:53:38,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store-tmp 2023-02-09 17:53:38,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:38,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 17:53:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:53:38,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:53:38,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 17:53:38,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:53:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:53:38,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675965218994Disabling compacts and flushes for region at 1675965218994Disabling writes for close at 1675965218995 (+1 ms)Writing region close event to WAL at 1675965218995Closed at 1675965218995 2023-02-09 17:53:38,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/WALs/jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:39,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37293%2C1675965217092, suffix=, logDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/WALs/jenkins-hbase4.apache.org,37293,1675965217092, archiveDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/oldWALs, maxLogs=10 2023-02-09 17:53:39,069 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK] 2023-02-09 17:53:39,076 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 17:53:39,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/WALs/jenkins-hbase4.apache.org,37293,1675965217092/jenkins-hbase4.apache.org%2C37293%2C1675965217092.1675965219029 2023-02-09 17:53:39,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK]] 2023-02-09 17:53:39,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:39,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:39,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,197 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,205 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 17:53:39,237 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 17:53:39,249 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:39,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 17:53:39,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:53:39,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72730291, jitterRate=0.08376578986644745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:53:39,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675965219166Initializing all the Stores at 1675965219168 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675965219169 (+1 ms)Cleaning up temporary data from old regions at 1675965219263 (+94 ms)Cleaning up detritus from prior splits at 1675965219264 (+1 ms)Region opened successfully at 1675965219279 (+15 ms) 2023-02-09 17:53:39,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 17:53:39,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 17:53:39,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 17:53:39,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 17:53:39,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 17:53:39,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 32 msec 2023-02-09 17:53:39,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 17:53:39,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 17:53:39,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 17:53:39,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 17:53:39,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 17:53:39,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 17:53:39,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 17:53:39,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 17:53:39,413 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:39,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 17:53:39,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 17:53:39,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 17:53:39,431 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 17:53:39,431 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 17:53:39,431 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:39,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37293,1675965217092, sessionid=0x1003a379fc60000, setting cluster-up flag (Was=false) 2023-02-09 17:53:39,450 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:39,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 17:53:39,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:39,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:39,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 17:53:39,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:39,474 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp 2023-02-09 17:53:39,555 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(952): ClusterId : f4fb2626-c547-4c96-8511-6d1e38fe1a93 2023-02-09 17:53:39,560 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 17:53:39,566 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 17:53:39,566 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 17:53:39,569 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 17:53:39,571 DEBUG [RS:0;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(139): Connect 0x43be4382 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:39,576 DEBUG [RS:0;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d79a585, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:39,576 DEBUG [RS:0;jenkins-hbase4:42581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@494628f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 17:53:39,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 17:53:39,599 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42581 2023-02-09 17:53:39,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 17:53:39,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675965249602 2023-02-09 17:53:39,603 INFO [RS:0;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 17:53:39,603 INFO [RS:0;jenkins-hbase4:42581] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 17:53:39,603 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 17:53:39,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 17:53:39,606 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37293,1675965217092 with isa=jenkins-hbase4.apache.org/172.31.14.131:42581, startcode=1675965218218 2023-02-09 17:53:39,608 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 17:53:39,608 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 17:53:39,614 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 17:53:39,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 17:53:39,624 DEBUG [RS:0;jenkins-hbase4:42581] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 17:53:39,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 17:53:39,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 17:53:39,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 17:53:39,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 17:53:39,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 17:53:39,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 17:53:39,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 17:53:39,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 17:53:39,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 17:53:39,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675965219633,5,FailOnTimeoutGroup] 2023-02-09 17:53:39,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675965219633,5,FailOnTimeoutGroup] 2023-02-09 17:53:39,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 17:53:39,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,674 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40993, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 17:53:39,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,700 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7 2023-02-09 17:53:39,700 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41421 2023-02-09 17:53:39,700 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 17:53:39,705 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 17:53:39,705 DEBUG [RS:0;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,706 WARN [RS:0;jenkins-hbase4:42581] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 17:53:39,706 INFO [RS:0;jenkins-hbase4:42581] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 17:53:39,707 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/WALs/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42581,1675965218218] 2023-02-09 17:53:39,715 DEBUG [RS:0;jenkins-hbase4:42581] zookeeper.ZKUtil(162): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,724 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 17:53:39,733 INFO [RS:0;jenkins-hbase4:42581] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 17:53:39,751 INFO [RS:0;jenkins-hbase4:42581] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 17:53:39,754 INFO [RS:0;jenkins-hbase4:42581] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:53:39,755 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,756 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 17:53:39,762 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,763 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,763 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,763 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,763 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,763 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,764 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 17:53:39,764 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,764 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,764 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,764 DEBUG [RS:0;jenkins-hbase4:42581] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 17:53:39,765 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,765 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,765 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,781 INFO [RS:0;jenkins-hbase4:42581] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 17:53:39,784 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42581,1675965218218-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:39,800 INFO [RS:0;jenkins-hbase4:42581] regionserver.Replication(203): jenkins-hbase4.apache.org,42581,1675965218218 started 2023-02-09 17:53:39,800 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42581,1675965218218, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42581, sessionid=0x1003a379fc60001 2023-02-09 17:53:39,800 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 17:53:39,800 DEBUG [RS:0;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,800 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1675965218218' 2023-02-09 17:53:39,800 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:39,801 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:39,801 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 17:53:39,802 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 17:53:39,802 DEBUG [RS:0;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:39,802 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42581,1675965218218' 2023-02-09 17:53:39,802 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 17:53:39,802 DEBUG [RS:0;jenkins-hbase4:42581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 17:53:39,803 DEBUG [RS:0;jenkins-hbase4:42581] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 17:53:39,803 INFO [RS:0;jenkins-hbase4:42581] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 17:53:39,803 INFO [RS:0;jenkins-hbase4:42581] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 17:53:39,913 INFO [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42581%2C1675965218218, suffix=, logDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/WALs/jenkins-hbase4.apache.org,42581,1675965218218, archiveDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/oldWALs, maxLogs=32 2023-02-09 17:53:39,931 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK] 2023-02-09 17:53:39,934 INFO [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/WALs/jenkins-hbase4.apache.org,42581,1675965218218/jenkins-hbase4.apache.org%2C42581%2C1675965218218.1675965219916 2023-02-09 17:53:39,935 DEBUG [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK]] 2023-02-09 17:53:40,045 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:40,046 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:40,046 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7 2023-02-09 17:53:40,460 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:40,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 17:53:40,465 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/info 2023-02-09 17:53:40,466 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 17:53:40,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,468 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 17:53:40,471 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/rep_barrier 2023-02-09 17:53:40,471 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 17:53:40,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,472 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 17:53:40,475 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/table 2023-02-09 17:53:40,475 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 17:53:40,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,477 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740 2023-02-09 17:53:40,478 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740 2023-02-09 17:53:40,481 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 17:53:40,483 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 17:53:40,487 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:53:40,488 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74870131, jitterRate=0.11565189063549042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 17:53:40,488 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675965220460Initializing all the Stores at 1675965220462 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675965220462Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675965220462Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675965220462Cleaning up temporary data from old regions at 1675965220480 (+18 ms)Cleaning up detritus from prior splits at 1675965220480Region opened successfully at 1675965220488 (+8 ms) 2023-02-09 17:53:40,488 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 17:53:40,488 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 17:53:40,488 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 17:53:40,488 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 17:53:40,488 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 17:53:40,489 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 17:53:40,489 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675965220488Disabling compacts and flushes for region at 1675965220488Disabling writes for close at 1675965220488Writing region close event to WAL at 1675965220489 (+1 ms)Closed at 1675965220489 2023-02-09 17:53:40,494 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 17:53:40,494 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 17:53:40,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 17:53:40,512 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 17:53:40,515 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 17:53:40,667 DEBUG [jenkins-hbase4:37293] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-09 17:53:40,670 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42581,1675965218218, state=OPENING 2023-02-09 17:53:40,679 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 17:53:40,680 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:40,681 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 17:53:40,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:40,866 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:40,868 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 17:53:40,872 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 17:53:40,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 17:53:40,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 17:53:40,886 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42581%2C1675965218218.meta, suffix=.meta, logDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/WALs/jenkins-hbase4.apache.org,42581,1675965218218, archiveDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/oldWALs, maxLogs=32 2023-02-09 17:53:40,902 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK] 2023-02-09 17:53:40,906 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/WALs/jenkins-hbase4.apache.org,42581,1675965218218/jenkins-hbase4.apache.org%2C42581%2C1675965218218.meta.1675965220888.meta 2023-02-09 17:53:40,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34373,DS-87bd4ebb-d8d7-471a-b6c2-3ea7ee02e8c6,DISK]] 2023-02-09 17:53:40,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:40,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 17:53:40,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 17:53:40,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 17:53:40,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 17:53:40,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:40,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 17:53:40,934 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 17:53:40,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 17:53:40,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/info 2023-02-09 17:53:40,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/info 2023-02-09 17:53:40,939 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 17:53:40,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 17:53:40,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/rep_barrier 2023-02-09 17:53:40,941 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/rep_barrier 2023-02-09 17:53:40,942 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 17:53:40,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,943 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 17:53:40,944 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/table 2023-02-09 17:53:40,944 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/table 2023-02-09 17:53:40,945 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 17:53:40,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:40,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740 2023-02-09 17:53:40,950 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740 2023-02-09 17:53:40,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 17:53:40,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 17:53:40,957 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64941291, jitterRate=-0.032299354672431946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 17:53:40,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675965220934Writing region info on filesystem at 1675965220935 (+1 ms)Initializing all the Stores at 1675965220936 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675965220936Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675965220937 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675965220937Cleaning up temporary data from old regions at 1675965220951 (+14 ms)Cleaning up detritus from prior splits at 1675965220952 (+1 ms)Running coprocessor post-open hooks at 1675965220957 (+5 ms)Region opened successfully at 1675965220957 2023-02-09 17:53:40,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675965220858 2023-02-09 17:53:40,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 17:53:40,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 17:53:40,986 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42581,1675965218218, state=OPEN 2023-02-09 17:53:40,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 17:53:40,990 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 17:53:40,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 17:53:40,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42581,1675965218218 in 307 msec 2023-02-09 17:53:40,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 17:53:40,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 494 msec 2023-02-09 17:53:41,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4810 sec 2023-02-09 17:53:41,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675965218277, completionTime=-1 2023-02-09 17:53:41,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-09 17:53:41,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 17:53:41,065 DEBUG [hconnection-0x12e4b88d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:53:41,069 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50390, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:53:41,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-09 17:53:41,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675965281086 2023-02-09 17:53:41,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675965341087 2023-02-09 17:53:41,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-09 17:53:41,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37293,1675965217092-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:41,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37293,1675965217092-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:41,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37293,1675965217092-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:41,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37293, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:41,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 17:53:41,120 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 17:53:41,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 17:53:41,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 17:53:41,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 17:53:41,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:53:41,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:53:41,165 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,167 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11 empty. 2023-02-09 17:53:41,168 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,168 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 17:53:41,590 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:41,593 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e87c0b70dc508223d272183bfbd0aa11, NAME => 'hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e87c0b70dc508223d272183bfbd0aa11, disabling compactions & flushes 2023-02-09 17:53:41,605 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. after waiting 0 ms 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:41,605 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:41,605 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e87c0b70dc508223d272183bfbd0aa11: Waiting for close lock at 1675965221605Disabling compacts and flushes for region at 1675965221605Disabling writes for close at 1675965221605Writing region close event to WAL at 1675965221605Closed at 1675965221605 2023-02-09 17:53:41,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:53:41,625 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675965221612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965221612"}]},"ts":"1675965221612"} 2023-02-09 17:53:41,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:53:41,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:53:41,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965221652"}]},"ts":"1675965221652"} 2023-02-09 17:53:41,662 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 17:53:41,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e87c0b70dc508223d272183bfbd0aa11, ASSIGN}] 2023-02-09 17:53:41,673 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e87c0b70dc508223d272183bfbd0aa11, ASSIGN 2023-02-09 17:53:41,675 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e87c0b70dc508223d272183bfbd0aa11, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:53:41,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e87c0b70dc508223d272183bfbd0aa11, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:41,826 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675965221825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965221825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965221825"}]},"ts":"1675965221825"} 2023-02-09 17:53:41,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e87c0b70dc508223d272183bfbd0aa11, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:41,991 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:41,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e87c0b70dc508223d272183bfbd0aa11, NAME => 'hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:41,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:41,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,995 INFO [StoreOpener-e87c0b70dc508223d272183bfbd0aa11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:41,997 DEBUG [StoreOpener-e87c0b70dc508223d272183bfbd0aa11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/info 2023-02-09 17:53:41,997 DEBUG [StoreOpener-e87c0b70dc508223d272183bfbd0aa11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/info 2023-02-09 17:53:41,998 INFO [StoreOpener-e87c0b70dc508223d272183bfbd0aa11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e87c0b70dc508223d272183bfbd0aa11 columnFamilyName info 2023-02-09 17:53:41,999 INFO [StoreOpener-e87c0b70dc508223d272183bfbd0aa11-1] regionserver.HStore(310): Store=e87c0b70dc508223d272183bfbd0aa11/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:42,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:42,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:42,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:53:42,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:53:42,011 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e87c0b70dc508223d272183bfbd0aa11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63451098, jitterRate=-0.054504960775375366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:53:42,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e87c0b70dc508223d272183bfbd0aa11: Running coprocessor pre-open hook at 1675965221993Writing region info on filesystem at 1675965221993Initializing all the Stores at 1675965221994 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675965221995 (+1 ms)Cleaning up temporary data from old regions at 1675965222002 (+7 ms)Cleaning up detritus from prior splits at 1675965222002Running coprocessor post-open hooks at 1675965222011 (+9 ms)Region opened successfully at 1675965222011 2023-02-09 17:53:42,013 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11., pid=6, masterSystemTime=1675965221985 2023-02-09 17:53:42,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:42,017 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:53:42,018 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e87c0b70dc508223d272183bfbd0aa11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:42,019 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675965222017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965222017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965222017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965222017"}]},"ts":"1675965222017"} 2023-02-09 17:53:42,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 17:53:42,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e87c0b70dc508223d272183bfbd0aa11, server=jenkins-hbase4.apache.org,42581,1675965218218 in 192 msec 2023-02-09 17:53:42,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 17:53:42,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e87c0b70dc508223d272183bfbd0aa11, ASSIGN in 355 msec 2023-02-09 17:53:42,031 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:53:42,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965222031"}]},"ts":"1675965222031"} 2023-02-09 17:53:42,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 17:53:42,038 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:53:42,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 908 msec 2023-02-09 17:53:42,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 17:53:42,044 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 17:53:42,044 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:53:42,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 17:53:42,103 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 17:53:42,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-09 17:53:42,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 17:53:42,127 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 17:53:42,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-09 17:53:42,143 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 17:53:42,146 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 17:53:42,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.859sec 2023-02-09 17:53:42,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 17:53:42,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 17:53:42,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 17:53:42,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37293,1675965217092-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 17:53:42,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37293,1675965217092-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 17:53:42,162 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(139): Connect 0x0672b468 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:42,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 17:53:42,167 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@561bf69b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:42,179 DEBUG [hconnection-0x78f916d2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:53:42,190 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50406, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:53:42,199 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:53:42,200 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(139): Connect 0x33fc1e18 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:42,207 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b586bb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:42,207 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:53:42,228 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=168, AvailableMemoryMB=4118 2023-02-09 17:53:42,231 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,231 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,238 DEBUG [Listener at localhost/44673] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:53:42,242 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:53:42,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:53:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:42,258 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:53:42,260 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:53:42,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-09 17:53:42,263 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:42,264 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba empty. 2023-02-09 17:53:42,266 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:42,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-09 17:53:42,269 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,269 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:42,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 17:53:42,376 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,376 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:42,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 17:53:42,578 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,579 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:42,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 17:53:42,684 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:42,686 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 500e9a4f9dd5c96df34dcabea31a3dba, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 500e9a4f9dd5c96df34dcabea31a3dba, disabling compactions & flushes 2023-02-09 17:53:42,698 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. after waiting 0 ms 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:42,698 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:42,698 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 500e9a4f9dd5c96df34dcabea31a3dba: Waiting for close lock at 1675965222698Disabling compacts and flushes for region at 1675965222698Disabling writes for close at 1675965222698Writing region close event to WAL at 1675965222698Closed at 1675965222698 2023-02-09 17:53:42,702 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:53:42,704 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965222704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965222704"}]},"ts":"1675965222704"} 2023-02-09 17:53:42,707 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:53:42,708 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:53:42,709 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965222708"}]},"ts":"1675965222708"} 2023-02-09 17:53:42,711 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-09 17:53:42,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, ASSIGN}] 2023-02-09 17:53:42,716 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, ASSIGN 2023-02-09 17:53:42,718 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:53:42,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:42,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965222869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965222869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965222869"}]},"ts":"1675965222869"} 2023-02-09 17:53:42,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:42,881 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:42,881 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:42,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 17:53:43,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:43,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 500e9a4f9dd5c96df34dcabea31a3dba, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:43,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:43,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,036 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,038 DEBUG [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:43,038 DEBUG [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:43,041 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 500e9a4f9dd5c96df34dcabea31a3dba columnFamilyName family1 2023-02-09 17:53:43,044 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] regionserver.HStore(310): Store=500e9a4f9dd5c96df34dcabea31a3dba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:43,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:43,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:53:43,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 500e9a4f9dd5c96df34dcabea31a3dba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66006917, jitterRate=-0.016420289874076843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:53:43,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 500e9a4f9dd5c96df34dcabea31a3dba: Running coprocessor pre-open hook at 1675965223033Writing region info on filesystem at 1675965223033Initializing all the Stores at 1675965223034 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965223034Cleaning up temporary data from old regions at 1675965223048 (+14 ms)Cleaning up detritus from prior splits at 1675965223048Running coprocessor post-open hooks at 1675965223057 (+9 ms)Region opened successfully at 1675965223057 2023-02-09 17:53:43,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., pid=11, masterSystemTime=1675965223026 2023-02-09 17:53:43,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:43,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:43,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:43,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965223062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965223062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965223062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965223062"}]},"ts":"1675965223062"} 2023-02-09 17:53:43,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 17:53:43,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218 in 193 msec 2023-02-09 17:53:43,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-09 17:53:43,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, ASSIGN in 355 msec 2023-02-09 17:53:43,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:53:43,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965223074"}]},"ts":"1675965223074"} 2023-02-09 17:53:43,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-09 17:53:43,080 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:53:43,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 826 msec 2023-02-09 17:53:43,383 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:43,383 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:43,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 17:53:43,386 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-09 17:53:43,406 DEBUG [hconnection-0x7aa6bd5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:53:43,410 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57576, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:53:43,568 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:43,569 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:43,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:43,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,580 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:43,580 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:43,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:43,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:43,582 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,582 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,585 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:43,585 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:43,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:43,585 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:43,585 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:43,591 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:43,591 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:43,591 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:43,592 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:43,593 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:53:44,170 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130dd57103144e34d3abdb24dde673aee22 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130dd57103144e34d3abdb24dde673aee22 2023-02-09 17:53:44,587 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/573a6aba54d24f68bf51933003543e7b 2023-02-09 17:53:44,600 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/573a6aba54d24f68bf51933003543e7b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b 2023-02-09 17:53:44,609 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-09 17:53:44,613 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 1019ms, sequenceid=5, compaction requested=false 2023-02-09 17:53:44,614 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:44,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:44,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:44,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:44,619 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:44,621 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:44,622 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,622 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:44,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:44,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7287b9dc[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:44,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:44,625 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:44,627 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:44,627 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,627 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:44,627 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:44,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:44,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:44,633 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:44,633 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:44,633 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:44,634 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,634 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:44,637 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,637 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:44,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,637 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:44,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:44,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:44,638 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,640 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,647 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,647 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:44,648 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:44,648 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:44,649 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:44,650 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:44,651 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:44,751 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:44,751 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:44,752 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:44,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:44,766 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:44,766 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:44,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,770 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:44,770 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:44,770 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:44,770 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:44,771 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,771 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,772 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:44,772 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:44,773 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:44,773 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:44,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:44,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:44,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:44,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:44,776 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:44,776 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:44,776 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:44,776 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:44,776 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:53:44,819 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280423bf0a9bd743a8bca7fd0aac157e46 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280423bf0a9bd743a8bca7fd0aac157e46 2023-02-09 17:53:45,232 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982 2023-02-09 17:53:45,242 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982 2023-02-09 17:53:45,251 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:53:45,253 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 477ms, sequenceid=9, compaction requested=false 2023-02-09 17:53:45,253 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:45,253 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:45,253 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:45,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:45,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:45,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:45,256 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,256 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:45,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:45,257 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,257 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:45,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:45,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3740cfc1[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:45,259 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:45,259 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,261 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:45,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:45,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:45,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:45,264 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,264 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:45,264 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:45,265 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:45,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:45,269 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:45,269 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:45,269 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:45,269 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,269 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:45,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:45,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:45,275 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,278 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:45,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:45,283 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:45,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,284 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:45,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:45,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:45,284 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:45,384 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:45,385 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:45,385 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:45,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:45,394 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:45,394 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:45,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:45,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:45,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,398 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:45,398 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:45,399 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:45,399 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:45,400 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,400 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,401 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:45,401 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:45,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:45,402 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:45,402 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:45,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:45,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,406 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:45,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:45,406 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:45,406 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:45,406 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:45,407 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:45,407 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:45,407 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:45,407 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:45,407 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:45,729 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 17:53:45,730 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 17:53:45,844 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a5046115e8e144c6a80f2ead03192d99 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a5046115e8e144c6a80f2ead03192d99 2023-02-09 17:53:46,259 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/c7f98d3d8f0045fb83905234d87e81ee 2023-02-09 17:53:46,270 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/c7f98d3d8f0045fb83905234d87e81ee as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee 2023-02-09 17:53:46,282 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 17:53:46,284 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 877ms, sequenceid=13, compaction requested=true 2023-02-09 17:53:46,284 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:46,285 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:46,287 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:46,288 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,288 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:46,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5064d09c[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:46,290 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:46,290 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,292 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:46,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:46,292 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,292 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:46,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:46,298 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:46,303 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:46,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:46,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:46,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,303 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:46,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:46,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:46,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,308 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:46,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:46,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:46,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:46,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,312 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:46,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:46,313 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:46,314 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:46,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:46,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,414 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:46,414 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:46,414 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:46,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:46,422 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:46,422 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:46,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,427 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:46,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:46,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:46,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:46,428 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,428 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,430 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:46,430 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,431 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:46,431 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:46,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:46,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:46,433 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:46,433 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:46,433 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:46,434 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:46,434 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:46,434 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:46,434 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:46,434 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:46,460 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:53:46,859 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f98cd8436ba94ecdb2c298d19c46ea75 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f98cd8436ba94ecdb2c298d19c46ea75 2023-02-09 17:53:47,255 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 17:53:47,256 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 17:53:47,273 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/bdc89030f67a42fd96e5e46934c526d7 2023-02-09 17:53:47,282 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/bdc89030f67a42fd96e5e46934c526d7 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7 2023-02-09 17:53:47,290 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 17:53:47,292 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 858ms, sequenceid=17, compaction requested=true 2023-02-09 17:53:47,292 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:47,292 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:47,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:47,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:47,296 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:47,296 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:47,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21462451[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:47,298 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:47,298 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,299 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:47,300 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,300 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:47,302 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:47,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:47,307 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:47,307 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:47,307 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:47,307 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,307 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:47,310 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,310 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,310 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:47,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:47,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:47,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:47,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,313 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:47,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:47,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:47,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:47,319 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:47,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:47,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:47,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:47,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:47,420 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:47,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:47,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:47,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:47,429 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:47,430 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:47,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:47,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:47,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,433 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:47,433 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:47,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:47,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:47,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,436 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:47,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:47,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:47,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:47,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:47,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,437 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,437 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:47,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:47,437 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:47,437 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:47,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:47,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:47,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:47,438 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:47,863 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228467b1ecb49d54b7ebe8cd882f2d85b97 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228467b1ecb49d54b7ebe8cd882f2d85b97 2023-02-09 17:53:48,274 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/3941965a0a9e456dbfd92ca06234b4e9 2023-02-09 17:53:48,283 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/3941965a0a9e456dbfd92ca06234b4e9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9 2023-02-09 17:53:48,291 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 17:53:48,293 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 855ms, sequenceid=21, compaction requested=true 2023-02-09 17:53:48,293 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:48,293 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:48,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:48,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:48,293 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,294 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:48,294 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:48,302 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ec020fc[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:48,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:48,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,306 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:48,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:48,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:48,307 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:48,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:48,311 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:48,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:48,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:48,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,311 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:48,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:48,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:48,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:48,315 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,316 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:48,319 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:48,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:48,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:48,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:48,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:48,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:48,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:48,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:48,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:48,420 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:48,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:48,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:48,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:48,429 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:48,430 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:48,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:48,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:48,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,433 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:48,433 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:48,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:48,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:48,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,436 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:48,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:48,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:48,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:48,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:48,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:48,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,437 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,437 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:48,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:48,437 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:48,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:48,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:48,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:48,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:48,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:48,438 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:48,867 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123113b1741d943348279e5f335d0931321d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123113b1741d943348279e5f335d0931321d 2023-02-09 17:53:49,278 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/05cad81d111744168e502f01fb638c66 2023-02-09 17:53:49,288 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/05cad81d111744168e502f01fb638c66 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66 2023-02-09 17:53:49,296 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 17:53:49,297 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 859ms, sequenceid=25, compaction requested=true 2023-02-09 17:53:49,297 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:49,298 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:49,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:49,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:49,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:49,298 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:49,300 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:49,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:49,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:49,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:49,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f4fd422[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:49,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:49,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,306 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:49,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:49,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:49,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:49,308 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:49,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:49,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:49,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:49,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:49,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:49,312 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:49,312 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:49,312 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:49,312 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,312 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:49,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:49,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:49,315 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,316 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,319 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:49,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:49,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:49,319 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:49,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:49,320 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:49,421 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:49,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:49,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:49,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:49,430 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:49,430 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:49,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:49,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:49,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,433 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:49,433 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:49,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:49,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:49,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,437 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:49,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:49,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:49,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:49,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:49,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:49,439 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:49,439 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:49,439 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:49,440 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:49,440 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:49,440 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:49,440 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:49,440 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:49,865 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101359b16a95ca040f5830ce6488dd003a8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101359b16a95ca040f5830ce6488dd003a8 2023-02-09 17:53:50,273 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/a810e2bedbf0487c9f200bf7e164f90b 2023-02-09 17:53:50,282 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/a810e2bedbf0487c9f200bf7e164f90b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b 2023-02-09 17:53:50,290 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 17:53:50,291 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 851ms, sequenceid=29, compaction requested=true 2023-02-09 17:53:50,291 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:50,291 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:50,291 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:50,294 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,294 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:50,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:50,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:50,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29d91f67[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:50,296 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:50,296 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,297 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,297 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:50,297 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:50,297 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:50,297 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,297 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:50,299 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,299 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:50,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:50,299 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:50,299 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:50,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:50,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:50,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:50,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:50,302 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:50,302 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:50,302 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:50,302 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,302 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:50,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:50,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,305 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:50,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,307 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:50,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:50,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:50,313 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:50,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:50,313 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:50,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,314 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:50,314 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:50,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:50,414 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:50,415 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:50,415 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:50,422 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:50,423 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:50,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,426 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:50,426 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:50,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:50,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:50,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,427 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,429 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,429 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:50,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:50,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:50,429 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:50,429 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:50,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,430 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:50,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:50,431 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:50,431 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:50,431 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:50,431 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:50,852 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103037d867c946945f9903e58505980634b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103037d867c946945f9903e58505980634b 2023-02-09 17:53:51,261 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/0d5ccb22d2e64b1499a8c95d7f31a818 2023-02-09 17:53:51,269 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/0d5ccb22d2e64b1499a8c95d7f31a818 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818 2023-02-09 17:53:51,276 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 17:53:51,277 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 846ms, sequenceid=33, compaction requested=true 2023-02-09 17:53:51,277 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:51,277 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:51,278 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:51,278 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:51,278 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,278 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:51,278 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:51,280 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,280 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:51,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:51,280 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,280 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:51,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:51,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@392dc2a1[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:51,282 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:51,282 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:51,284 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:51,284 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,284 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:51,286 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:51,286 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,286 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:51,286 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:51,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:51,289 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:51,289 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:51,289 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:51,289 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,289 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:51,290 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,290 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:51,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,290 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:51,291 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:51,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,292 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,294 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,294 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,294 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:51,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,295 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:51,295 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:51,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:51,296 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:51,296 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:51,396 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:51,397 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:51,397 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:51,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:51,405 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:51,405 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:51,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:51,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:51,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,409 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:51,409 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:51,409 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:51,409 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:51,410 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,410 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,412 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,412 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:51,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:51,412 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:51,412 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,413 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:51,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:51,416 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:51,416 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:51,416 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:51,416 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:51,416 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:51,840 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f3f4c8d306ae43b798d6142e066bf04e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907f3f4c8d306ae43b798d6142e066bf04e 2023-02-09 17:53:52,249 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/bb224440c91a464db41db694f54b7b6b 2023-02-09 17:53:52,257 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/bb224440c91a464db41db694f54b7b6b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b 2023-02-09 17:53:52,264 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 17:53:52,266 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 850ms, sequenceid=37, compaction requested=true 2023-02-09 17:53:52,266 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:52,266 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:52,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:52,267 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:52,267 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,267 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:52,267 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:52,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:52,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:52,269 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:52,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:52,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5685c2b8[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:52,270 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:52,270 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,271 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:52,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:52,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:52,271 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,272 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:52,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:52,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:52,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:52,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:52,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:52,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:52,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:52,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:52,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:52,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:52,277 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:52,277 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:52,277 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:52,277 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,277 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:52,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:52,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:52,280 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:52,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:52,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:52,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:52,281 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:52,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:52,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:52,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:52,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:52,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:52,284 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:52,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:52,284 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 17:53:52,285 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:52,285 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:52,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:52,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:52,385 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:52,385 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:52,385 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:52,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:52,393 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:52,393 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:52,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:52,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 17:53:52,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,396 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:52,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:52,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 17:53:52,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 17:53:52,397 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,397 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,398 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:52,398 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:52,399 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:52,399 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 17:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 17:53:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:52,402 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 17:53:52,402 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:52,402 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:52,402 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:52,402 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. started... 2023-02-09 17:53:52,402 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 500e9a4f9dd5c96df34dcabea31a3dba 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:53:52,823 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120dc9340a42a6d4f62b0532e1f7b33b772 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc9340a42a6d4f62b0532e1f7b33b772 2023-02-09 17:53:53,232 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/78b31a53e541441f9d06828ef9535012 2023-02-09 17:53:53,240 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/78b31a53e541441f9d06828ef9535012 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012 2023-02-09 17:53:53,246 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 17:53:53,247 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500e9a4f9dd5c96df34dcabea31a3dba in 845ms, sequenceid=41, compaction requested=true 2023-02-09 17:53:53,247 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:53,247 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:53,247 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:53,248 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:53,248 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,248 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 17:53:53,248 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 17:53:53,250 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,250 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:53,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,251 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:53,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:53,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:53,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:53,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 17:53:53,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cae28e[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:53,252 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 17:53:53,252 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,254 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 17:53:53,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 17:53:53,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:53,254 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,254 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:53,259 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,259 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 17:53:53,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:53,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:53,259 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:53,259 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 17:53:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:53,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 17:53:53,262 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 17:53:53,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:53,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:53,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,262 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:53,264 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,264 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:53,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:53,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,264 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:53,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:53,265 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,266 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:53,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,268 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:53,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:53,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:53,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:53,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:53,269 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:53:53,370 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:53:53,370 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:53,370 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:53,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:53:53,376 DEBUG [Listener at localhost/44673] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 17:53:53,378 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 17:53:53,380 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:53,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:53,393 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:53,395 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965833395 2023-02-09 17:53:53,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:53:53,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:53:53,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 17:53:53,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:53,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x267403d3 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:53,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70d34599, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:53,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:53,898 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034076c09226454ff58bbcb4639bd084d2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601034076c09226454ff58bbcb4639bd084d2 2023-02-09 17:53:53,899 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:53,917 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:53:53,919 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34906, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:53:53,929 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:53,929 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:53,930 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:53:53,931 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:53:53,964 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3b04588bfaa496ca6a9660c04c39667 first=Optional[r3] last=Optional[r6] 2023-02-09 17:53:53,976 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3b04588bfaa496ca6a9660c04c39667}] 2023-02-09 17:53:53,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3b04588bfaa496ca6a9660c04c39667 for inclusion in 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 17:53:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:53:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:54,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3b04588bfaa496ca6a9660c04c39667 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7t24tl2090e5r8j3vtf12u7oa3tni149ic4bt9thl0hrg5jr1ssi9o8lgcpkocb7/family1/a3b04588bfaa496ca6a9660c04c39667 2023-02-09 17:53:54,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7t24tl2090e5r8j3vtf12u7oa3tni149ic4bt9thl0hrg5jr1ssi9o8lgcpkocb7/family1/a3b04588bfaa496ca6a9660c04c39667 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_ 2023-02-09 17:53:54,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7t24tl2090e5r8j3vtf12u7oa3tni149ic4bt9thl0hrg5jr1ssi9o8lgcpkocb7/family1/a3b04588bfaa496ca6a9660c04c39667 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_ - updating store file list. 2023-02-09 17:53:54,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_ into 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:54,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7t24tl2090e5r8j3vtf12u7oa3tni149ic4bt9thl0hrg5jr1ssi9o8lgcpkocb7/family1/a3b04588bfaa496ca6a9660c04c39667 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_) 2023-02-09 17:53:54,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7t24tl2090e5r8j3vtf12u7oa3tni149ic4bt9thl0hrg5jr1ssi9o8lgcpkocb7/family1/a3b04588bfaa496ca6a9660c04c39667 2023-02-09 17:53:54,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:53:54,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:53:54,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 500e9a4f9dd5c96df34dcabea31a3dba/family1 is initiating minor compaction 2023-02-09 17:53:54,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d76d339; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:53:54,022 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 500e9a4f9dd5c96df34dcabea31a3dba/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:54,023 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp, totalSize=50.2 K 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 4a3aa8d85cfd4cd3a7a9ddd8094e3982, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c7f98d3d8f0045fb83905234d87e81ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting bdc89030f67a42fd96e5e46934c526d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3941965a0a9e456dbfd92ca06234b4e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 05cad81d111744168e502f01fb638c66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:53:54,023 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a810e2bedbf0487c9f200bf7e164f90b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:53:54,024 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 0d5ccb22d2e64b1499a8c95d7f31a818, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:53:54,024 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting bb224440c91a464db41db694f54b7b6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:53:54,024 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 78b31a53e541441f9d06828ef9535012, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:53:54,024 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting f53cd7e597954362b5ce7321753afbfb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:53:54,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:54,038 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:53:54,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228467b1ecb49d54b7ebe8cd882f2d85b97 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228467b1ecb49d54b7ebe8cd882f2d85b97 2023-02-09 17:53:54,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123113b1741d943348279e5f335d0931321d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123113b1741d943348279e5f335d0931321d 2023-02-09 17:53:54,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101359b16a95ca040f5830ce6488dd003a8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101359b16a95ca040f5830ce6488dd003a8 2023-02-09 17:53:54,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103037d867c946945f9903e58505980634b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103037d867c946945f9903e58505980634b 2023-02-09 17:53:54,052 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-09 17:53:54,052 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 17:53:54,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,079 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 500e9a4f9dd5c96df34dcabea31a3dba#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:53:54,103 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/a4237228c3704a26a7fedd888048cdf2 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a4237228c3704a26a7fedd888048cdf2 2023-02-09 17:53:54,119 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 500e9a4f9dd5c96df34dcabea31a3dba/family1 of 500e9a4f9dd5c96df34dcabea31a3dba into a4237228c3704a26a7fedd888048cdf2(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:53:54,119 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:54,121 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675965234020; duration=0sec 2023-02-09 17:53:54,121 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:53:54,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_] to archive 2023-02-09 17:53:54,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:53:54,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/4a3aa8d85cfd4cd3a7a9ddd8094e3982 2023-02-09 17:53:54,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c7f98d3d8f0045fb83905234d87e81ee 2023-02-09 17:53:54,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bdc89030f67a42fd96e5e46934c526d7 2023-02-09 17:53:54,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3941965a0a9e456dbfd92ca06234b4e9 2023-02-09 17:53:54,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/05cad81d111744168e502f01fb638c66 2023-02-09 17:53:54,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a810e2bedbf0487c9f200bf7e164f90b 2023-02-09 17:53:54,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/0d5ccb22d2e64b1499a8c95d7f31a818 2023-02-09 17:53:54,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/bb224440c91a464db41db694f54b7b6b 2023-02-09 17:53:54,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/78b31a53e541441f9d06828ef9535012 2023-02-09 17:53:54,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/f53cd7e597954362b5ce7321753afbfb_SeqId_44_ 2023-02-09 17:53:54,547 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056c1eaf0acac648a2b689f858bfda01d6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512056c1eaf0acac648a2b689f858bfda01d6 2023-02-09 17:53:54,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:54,568 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:54,568 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:54,578 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6f7fc66b7b374f999ffc563a31eafcc0 first=Optional[r00] last=Optional[r2] 2023-02-09 17:53:54,579 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6f7fc66b7b374f999ffc563a31eafcc0}] 2023-02-09 17:53:54,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6f7fc66b7b374f999ffc563a31eafcc0 for inclusion in 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 17:53:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:53:54,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:54,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6f7fc66b7b374f999ffc563a31eafcc0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c03d5vse4lil8viefsmhttsocl0gve0r9dafn20e5ogu4ilmsjso1mb0o2kkhgsn/family1/6f7fc66b7b374f999ffc563a31eafcc0 2023-02-09 17:53:54,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c03d5vse4lil8viefsmhttsocl0gve0r9dafn20e5ogu4ilmsjso1mb0o2kkhgsn/family1/6f7fc66b7b374f999ffc563a31eafcc0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_ 2023-02-09 17:53:54,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c03d5vse4lil8viefsmhttsocl0gve0r9dafn20e5ogu4ilmsjso1mb0o2kkhgsn/family1/6f7fc66b7b374f999ffc563a31eafcc0 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_ - updating store file list. 2023-02-09 17:53:54,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_ into 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:54,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c03d5vse4lil8viefsmhttsocl0gve0r9dafn20e5ogu4ilmsjso1mb0o2kkhgsn/family1/6f7fc66b7b374f999ffc563a31eafcc0 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_) 2023-02-09 17:53:54,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c03d5vse4lil8viefsmhttsocl0gve0r9dafn20e5ogu4ilmsjso1mb0o2kkhgsn/family1/6f7fc66b7b374f999ffc563a31eafcc0 2023-02-09 17:53:54,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:53:54,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:53:54,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 500e9a4f9dd5c96df34dcabea31a3dba/family1 is initiating minor compaction (all files) 2023-02-09 17:53:54,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b7fb7c4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:53:54,601 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 500e9a4f9dd5c96df34dcabea31a3dba/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:54,602 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a4237228c3704a26a7fedd888048cdf2, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp, totalSize=358.6 K 2023-02-09 17:53:54,603 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 573a6aba54d24f68bf51933003543e7b, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:53:54,604 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a4237228c3704a26a7fedd888048cdf2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:53:54,604 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c32d50e005cc48bdb96621e692cccf05_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842209 2023-02-09 17:53:54,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:54,606 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:53:54,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130dd57103144e34d3abdb24dde673aee22 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130dd57103144e34d3abdb24dde673aee22 2023-02-09 17:53:54,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a5046115e8e144c6a80f2ead03192d99 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a5046115e8e144c6a80f2ead03192d99 2023-02-09 17:53:54,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f98cd8436ba94ecdb2c298d19c46ea75 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f98cd8436ba94ecdb2c298d19c46ea75 2023-02-09 17:53:54,612 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-09 17:53:54,612 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 17:53:54,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:54,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:54,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:53:54,613 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:54,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.2280 sec 2023-02-09 17:53:54,639 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 500e9a4f9dd5c96df34dcabea31a3dba#family1#compaction#11 average throughput is 7.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:53:54,766 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:54,766 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:54,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 17:53:54,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:55,201 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 17:53:55,202 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:55,202 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 17:53:55,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-09 17:53:55,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, REOPEN/MOVE}] 2023-02-09 17:53:55,220 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, REOPEN/MOVE 2023-02-09 17:53:55,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:55,221 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965235221"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965235221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965235221"}]},"ts":"1675965235221"} 2023-02-09 17:53:55,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:55,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:55,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 500e9a4f9dd5c96df34dcabea31a3dba, disabling compactions & flushes 2023-02-09 17:53:55,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:55,869 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/.tmp/family1/c31a63dc39014c96afd99355fa1d68a0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c31a63dc39014c96afd99355fa1d68a0 2023-02-09 17:53:55,877 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 500e9a4f9dd5c96df34dcabea31a3dba/family1 of 500e9a4f9dd5c96df34dcabea31a3dba into c31a63dc39014c96afd99355fa1d68a0(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:53:55,877 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:55,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:55,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:55,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. after waiting 0 ms 2023-02-09 17:53:55,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:55,877 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675965234601; duration=1sec 2023-02-09 17:53:55,877 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:53:55,880 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a4237228c3704a26a7fedd888048cdf2, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_] to archive 2023-02-09 17:53:55,881 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:53:55,883 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/573a6aba54d24f68bf51933003543e7b 2023-02-09 17:53:55,884 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a4237228c3704a26a7fedd888048cdf2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/a4237228c3704a26a7fedd888048cdf2 2023-02-09 17:53:55,886 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c32d50e005cc48bdb96621e692cccf05_SeqId_47_ 2023-02-09 17:53:55,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 17:53:55,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:55,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 500e9a4f9dd5c96df34dcabea31a3dba: Waiting for close lock at 1675965235385Running coprocessor pre-close hooks at 1675965235385Disabling compacts and flushes for region at 1675965235385Disabling writes for close at 1675965235877 (+492 ms)Writing region close event to WAL at 1675965235889 (+12 ms)Running coprocessor post-close hooks at 1675965235893 (+4 ms)Closed at 1675965235893 2023-02-09 17:53:55,893 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 500e9a4f9dd5c96df34dcabea31a3dba to self. 2023-02-09 17:53:55,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:55,896 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=CLOSED 2023-02-09 17:53:55,897 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965235896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965235896"}]},"ts":"1675965235896"} 2023-02-09 17:53:55,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 17:53:55,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218 in 674 msec 2023-02-09 17:53:55,902 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=true 2023-02-09 17:53:56,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:56,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965236052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965236052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965236052"}]},"ts":"1675965236052"} 2023-02-09 17:53:56,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:56,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:56,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 500e9a4f9dd5c96df34dcabea31a3dba, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:56,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:56,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,212 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,214 DEBUG [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:56,214 DEBUG [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:56,214 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 500e9a4f9dd5c96df34dcabea31a3dba columnFamilyName family1 2023-02-09 17:53:56,221 DEBUG [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/c31a63dc39014c96afd99355fa1d68a0 2023-02-09 17:53:56,222 INFO [StoreOpener-500e9a4f9dd5c96df34dcabea31a3dba-1] regionserver.HStore(310): Store=500e9a4f9dd5c96df34dcabea31a3dba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:56,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:53:56,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 500e9a4f9dd5c96df34dcabea31a3dba; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60123442, jitterRate=-0.10409089922904968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:53:56,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 500e9a4f9dd5c96df34dcabea31a3dba: Running coprocessor pre-open hook at 1675965236211Writing region info on filesystem at 1675965236211Initializing all the Stores at 1675965236212 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675965236212Cleaning up temporary data from old regions at 1675965236225 (+13 ms)Cleaning up detritus from prior splits at 1675965236225Running coprocessor post-open hooks at 1675965236228 (+3 ms)Region opened successfully at 1675965236228 2023-02-09 17:53:56,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., pid=17, masterSystemTime=1675965236207 2023-02-09 17:53:56,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:56,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:53:56,231 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=500e9a4f9dd5c96df34dcabea31a3dba, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:56,232 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675965236231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965236231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965236231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965236231"}]},"ts":"1675965236231"} 2023-02-09 17:53:56,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-09 17:53:56,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 500e9a4f9dd5c96df34dcabea31a3dba, server=jenkins-hbase4.apache.org,42581,1675965218218 in 178 msec 2023-02-09 17:53:56,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-09 17:53:56,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=500e9a4f9dd5c96df34dcabea31a3dba, REOPEN/MOVE in 1.0160 sec 2023-02-09 17:53:56,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-09 17:53:56,241 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0320 sec 2023-02-09 17:53:56,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4650 sec 2023-02-09 17:53:56,245 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:56,246 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:56,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-09 17:53:56,248 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:56,248 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:56,253 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:56,253 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:56,254 INFO [Listener at localhost/44673] compactions.TestMobCompactor(278): alter status finished 2023-02-09 17:53:56,255 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 17:53:56,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:56,257 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:56,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:53:56,258 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965836258 2023-02-09 17:53:56,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:53:56,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 17:53:56,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:56,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x0ddd57b7 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:53:56,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b4b7125, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:53:56,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:56,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:56,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:56,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:56,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:57,102 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cb957c100d9a440f9601969d9f4b38c3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128cb957c100d9a440f9601969d9f4b38c3 2023-02-09 17:53:57,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:57,116 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:53:57,117 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:53:57,125 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,125 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,125 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:53:57,127 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:53:57,138 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68d18212a753429b826aa5df276df591 first=Optional[r05] last=Optional[r8] 2023-02-09 17:53:57,138 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68d18212a753429b826aa5df276df591}] 2023-02-09 17:53:57,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68d18212a753429b826aa5df276df591 for inclusion in 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:57,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 17:53:57,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:53:57,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 500e9a4f9dd5c96df34dcabea31a3dba: 2023-02-09 17:53:57,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68d18212a753429b826aa5df276df591 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4tfa8pjusic7odjvk2afqcm38um51gm0gtt3glv2887qkbsefdjum0h22ducaotu/family1/68d18212a753429b826aa5df276df591 2023-02-09 17:53:57,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4tfa8pjusic7odjvk2afqcm38um51gm0gtt3glv2887qkbsefdjum0h22ducaotu/family1/68d18212a753429b826aa5df276df591 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3afcc95072ad477aad637d86fcd6c156_SeqId_53_ 2023-02-09 17:53:57,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4tfa8pjusic7odjvk2afqcm38um51gm0gtt3glv2887qkbsefdjum0h22ducaotu/family1/68d18212a753429b826aa5df276df591 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3afcc95072ad477aad637d86fcd6c156_SeqId_53_ - updating store file list. 2023-02-09 17:53:57,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3afcc95072ad477aad637d86fcd6c156_SeqId_53_ into 500e9a4f9dd5c96df34dcabea31a3dba/family1 2023-02-09 17:53:57,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4tfa8pjusic7odjvk2afqcm38um51gm0gtt3glv2887qkbsefdjum0h22ducaotu/family1/68d18212a753429b826aa5df276df591 into 500e9a4f9dd5c96df34dcabea31a3dba/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/family1/3afcc95072ad477aad637d86fcd6c156_SeqId_53_) 2023-02-09 17:53:57,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4tfa8pjusic7odjvk2afqcm38um51gm0gtt3glv2887qkbsefdjum0h22ducaotu/family1/68d18212a753429b826aa5df276df591 2023-02-09 17:53:57,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:57,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:53:57,163 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc9340a42a6d4f62b0532e1f7b33b772 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc9340a42a6d4f62b0532e1f7b33b772 2023-02-09 17:53:57,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280423bf0a9bd743a8bca7fd0aac157e46 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280423bf0a9bd743a8bca7fd0aac157e46 2023-02-09 17:53:57,164 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-09 17:53:57,164 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 17:53:57,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:57,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:57,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 17:53:57,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 17:53:57,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:53:57,166 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 17:53:57,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 910 msec 2023-02-09 17:53:57,254 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 211) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:48230 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x267403d3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x0ddd57b7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1791735639.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41242 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1020131656_15 at /127.0.0.1:41172 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41196 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41210 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2346507a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x0ddd57b7-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41290 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x0ddd57b7-SendThread(127.0.0.1:59572) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x7def11ef-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41110 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x267403d3-SendThread(127.0.0.1:59572) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41142 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:48286 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7def11ef-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41170 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41192 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41188 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2346507a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7def11ef-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:48258 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41226 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x267403d3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1791735639.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:42581-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41162 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:41292 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 329), ProcessCount=168 (was 168), AvailableMemoryMB=4015 (was 4118) 2023-02-09 17:53:57,265 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=168, AvailableMemoryMB=4014 2023-02-09 17:53:57,266 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,266 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:57,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 17:53:57,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:57,270 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:53:57,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-09 17:53:57,271 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,271 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:57,271 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:53:57,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:57,273 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:57,274 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18 empty. 2023-02-09 17:53:57,274 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:57,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-09 17:53:57,372 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,372 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:57,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:57,574 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,574 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:57,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:57,683 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 17:53:57,685 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0d34b4f06061d789d27ca604cbf3df18, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:53:57,875 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:57,875 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:57,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 0d34b4f06061d789d27ca604cbf3df18, disabling compactions & flushes 2023-02-09 17:53:58,092 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. after waiting 0 ms 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,092 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,092 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 0d34b4f06061d789d27ca604cbf3df18: Waiting for close lock at 1675965238092Disabling compacts and flushes for region at 1675965238092Disabling writes for close at 1675965238092Writing region close event to WAL at 1675965238092Closed at 1675965238092 2023-02-09 17:53:58,095 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:53:58,096 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965238096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965238096"}]},"ts":"1675965238096"} 2023-02-09 17:53:58,098 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:53:58,099 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:53:58,099 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965238099"}]},"ts":"1675965238099"} 2023-02-09 17:53:58,100 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 17:53:58,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0d34b4f06061d789d27ca604cbf3df18, ASSIGN}] 2023-02-09 17:53:58,104 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0d34b4f06061d789d27ca604cbf3df18, ASSIGN 2023-02-09 17:53:58,105 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0d34b4f06061d789d27ca604cbf3df18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:53:58,256 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0d34b4f06061d789d27ca604cbf3df18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:58,256 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965238256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965238256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965238256"}]},"ts":"1675965238256"} 2023-02-09 17:53:58,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 0d34b4f06061d789d27ca604cbf3df18, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:53:58,377 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:58,377 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:58,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d34b4f06061d789d27ca604cbf3df18, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,417 INFO [StoreOpener-0d34b4f06061d789d27ca604cbf3df18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,418 DEBUG [StoreOpener-0d34b4f06061d789d27ca604cbf3df18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:53:58,419 DEBUG [StoreOpener-0d34b4f06061d789d27ca604cbf3df18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:53:58,419 INFO [StoreOpener-0d34b4f06061d789d27ca604cbf3df18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d34b4f06061d789d27ca604cbf3df18 columnFamilyName family1 2023-02-09 17:53:58,421 INFO [StoreOpener-0d34b4f06061d789d27ca604cbf3df18-1] regionserver.HStore(310): Store=0d34b4f06061d789d27ca604cbf3df18/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:53:58,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:53:58,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:53:58,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d34b4f06061d789d27ca604cbf3df18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62232461, jitterRate=-0.07266406714916229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:53:58,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d34b4f06061d789d27ca604cbf3df18: Running coprocessor pre-open hook at 1675965238415Writing region info on filesystem at 1675965238415Initializing all the Stores at 1675965238416 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675965238416Cleaning up temporary data from old regions at 1675965238423 (+7 ms)Cleaning up detritus from prior splits at 1675965238423Running coprocessor post-open hooks at 1675965238428 (+5 ms)Region opened successfully at 1675965238428 2023-02-09 17:53:58,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., pid=21, masterSystemTime=1675965238411 2023-02-09 17:53:58,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:58,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0d34b4f06061d789d27ca604cbf3df18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:58,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965238432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965238432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965238432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965238432"}]},"ts":"1675965238432"} 2023-02-09 17:53:58,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-09 17:53:58,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 0d34b4f06061d789d27ca604cbf3df18, server=jenkins-hbase4.apache.org,42581,1675965218218 in 175 msec 2023-02-09 17:53:58,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-09 17:53:58,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0d34b4f06061d789d27ca604cbf3df18, ASSIGN in 333 msec 2023-02-09 17:53:58,439 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:53:58,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965238440"}]},"ts":"1675965238440"} 2023-02-09 17:53:58,441 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 17:53:58,444 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:53:58,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1760 sec 2023-02-09 17:53:59,378 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:59,379 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:59,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 17:53:59,380 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-09 17:53:59,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:53:59,421 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:53:59,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:53:59,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,424 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:53:59,424 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:59,425 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:53:59,425 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:53:59,425 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,425 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,428 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:59,428 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:59,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:59,428 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,429 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:53:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:53:59,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,429 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:53:59,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:53:59,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:53:59,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:53:59,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:53:59,430 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:59,431 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:53:59,431 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:53:59,859 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130424da2fbaceb4791a7da01793f91ba4a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130424da2fbaceb4791a7da01793f91ba4a 2023-02-09 17:53:59,865 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/c7413969e36a41e7a6cc9b9a831d8402 2023-02-09 17:53:59,875 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/c7413969e36a41e7a6cc9b9a831d8402 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402 2023-02-09 17:53:59,882 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 17:53:59,883 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 452ms, sequenceid=5, compaction requested=false 2023-02-09 17:53:59,883 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:53:59,884 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:53:59,884 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:53:59,884 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:53:59,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:53:59,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:53:59,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:53:59,886 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,887 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:59,887 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,887 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:53:59,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:53:59,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1689f937[Count = 0] remaining members to acquire global barrier 2023-02-09 17:53:59,889 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:53:59,889 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,891 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:53:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:53:59,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:53:59,892 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,892 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:59,893 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:53:59,894 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:59,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:59,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:59,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:59,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:59,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:53:59,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:53:59,897 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:53:59,897 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:53:59,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:53:59,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,898 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:53:59,900 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,900 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:59,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,901 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:53:59,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:53:59,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,902 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:53:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,904 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:53:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:53:59,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:53:59,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:53:59,907 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:53:59,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:53:59,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:53:59,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:53:59,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:53:59,908 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,908 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,908 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:53:59,908 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:53:59,908 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:00,008 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:00,009 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:00,009 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:00,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:00,015 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:00,015 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:00,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:00,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:00,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,018 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:00,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:00,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:00,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:00,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,020 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:00,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:00,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,022 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:00,022 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:00,023 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:00,023 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:00,023 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:54:00,441 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ab64060095bc4644afb5a8c8a314949c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab64060095bc4644afb5a8c8a314949c 2023-02-09 17:54:00,852 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/9da3157b33324b19b2849b9133d18a83 2023-02-09 17:54:00,860 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/9da3157b33324b19b2849b9133d18a83 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83 2023-02-09 17:54:00,865 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:00,867 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 844ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:00,867 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:00,867 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:00,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:00,869 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,869 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:00,870 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,870 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:00,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:00,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:00,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:00,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41e6198d[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:00,871 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:00,872 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,873 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,873 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:00,873 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:00,873 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:00,873 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,873 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:00,874 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:00,874 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,874 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:00,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:00,878 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:00,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:00,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:00,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,878 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:00,881 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,881 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,881 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:00,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:00,882 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,883 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:00,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:00,888 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:00,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:00,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:00,888 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:00,889 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,889 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,889 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:00,889 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:00,989 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:00,990 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:00,990 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:00,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:00,995 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:00,995 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:00,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,998 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:00,998 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:00,999 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:00,999 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:00,999 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:00,999 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,001 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,001 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:01,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:01,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:01,001 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,001 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:01,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:01,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,002 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:01,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,002 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:01,002 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:01,003 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:01,003 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:01,003 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:01,003 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:01,003 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:01,003 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:01,419 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015c7309bc14f641a0b03beb34b43bb08c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015c7309bc14f641a0b03beb34b43bb08c 2023-02-09 17:54:01,429 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:54:01,825 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4663990e4e274f4b8fd72750a3516170 2023-02-09 17:54:01,834 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4663990e4e274f4b8fd72750a3516170 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170 2023-02-09 17:54:01,841 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 17:54:01,842 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 839ms, sequenceid=13, compaction requested=true 2023-02-09 17:54:01,842 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:01,842 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:01,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:01,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:01,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:01,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:01,845 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,845 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:01,845 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,846 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:01,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:01,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@390e930b[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:01,850 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:01,850 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:01,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:01,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:01,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:01,853 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:01,854 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:01,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:01,857 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:01,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:01,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:01,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,858 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:01,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:01,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:01,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:01,869 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:01,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,871 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:01,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,876 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,876 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:01,876 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,876 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:01,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:01,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:01,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:01,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:01,876 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:01,876 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:01,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:01,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:01,878 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:01,978 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:01,978 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:01,978 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:01,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:01,984 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:01,985 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:01,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:01,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:01,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,988 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:01,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:01,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:01,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:01,989 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,989 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,990 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:01,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:01,991 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:01,991 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:01,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:01,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,992 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,993 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:01,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:01,993 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:01,993 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:01,993 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:01,995 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:01,995 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:01,995 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:01,995 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:01,995 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:02,429 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053b32fdd1800647c389232547b8d60666 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053b32fdd1800647c389232547b8d60666 2023-02-09 17:54:02,435 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/0053015d1e4f46e89e6c68963c07565f 2023-02-09 17:54:02,441 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/0053015d1e4f46e89e6c68963c07565f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f 2023-02-09 17:54:02,446 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 17:54:02,447 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 452ms, sequenceid=17, compaction requested=true 2023-02-09 17:54:02,447 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:02,447 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:02,448 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:02,505 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:02,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:02,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:02,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1970c836[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:02,510 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:02,510 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,591 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:02,591 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,591 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:02,667 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:02,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:02,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:02,670 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:02,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:02,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:02,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,670 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:02,752 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,752 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:02,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,752 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:02,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:02,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:02,753 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:02,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,756 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:02,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:02,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:02,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:02,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:02,836 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:02,837 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:02,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:02,837 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:02,837 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,837 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,837 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:02,937 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:02,937 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:02,938 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:02,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:02,943 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:02,943 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:02,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:02,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:02,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,945 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:02,945 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:02,946 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:02,946 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:02,947 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:02,947 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,021 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:03,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:03,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,023 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:03,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:03,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:03,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:03,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:03,023 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:03,024 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:03,024 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:03,024 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:03,439 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282d1f6074785548cfa348df2187419e78 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282d1f6074785548cfa348df2187419e78 2023-02-09 17:54:03,848 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/619d390660c743c7b1fd9d731cdcc6b9 2023-02-09 17:54:03,855 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/619d390660c743c7b1fd9d731cdcc6b9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9 2023-02-09 17:54:03,860 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 17:54:03,861 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 837ms, sequenceid=21, compaction requested=true 2023-02-09 17:54:03,861 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:03,861 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:03,861 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:03,861 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:03,861 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,861 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:03,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:03,863 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,863 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:03,863 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:03,864 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:03,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e9ca6e[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:03,865 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:03,865 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,867 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:03,867 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,867 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:03,868 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:03,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:03,872 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:03,872 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:03,872 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:03,872 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,872 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:03,877 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,877 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,877 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:03,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:03,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:03,879 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,884 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:03,884 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:03,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:03,884 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:03,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:03,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:03,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:03,884 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:03,885 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,885 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:03,885 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:03,885 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,886 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,886 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,886 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,886 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,986 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:03,986 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:03,986 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:03,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:03,992 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:03,992 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:03,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:03,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:03,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,995 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:03,995 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:03,996 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:03,996 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:03,996 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,996 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,998 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,998 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:03,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:03,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:03,998 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:03,998 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:03,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:03,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,999 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:03,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:04,000 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:04,000 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:04,000 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:04,000 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:04,000 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:04,000 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:04,418 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314b3e5516217044258059d2af4f50444c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314b3e5516217044258059d2af4f50444c 2023-02-09 17:54:04,825 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/a88e5e31e474412cba4441103efec428 2023-02-09 17:54:04,832 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/a88e5e31e474412cba4441103efec428 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428 2023-02-09 17:54:04,838 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 17:54:04,839 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 839ms, sequenceid=25, compaction requested=true 2023-02-09 17:54:04,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:04,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:04,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:04,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:04,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:04,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:04,842 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:04,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:04,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:04,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3132898f[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:04,843 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:04,844 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,845 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,845 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:04,845 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:04,845 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,845 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:04,845 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:04,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:04,847 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:04,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:04,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:04,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:04,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:04,851 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:04,851 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:04,851 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:04,851 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,851 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:04,853 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,853 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:04,853 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:04,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:04,854 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,855 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:04,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:04,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:04,859 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:04,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:04,859 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:04,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:04,959 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:04,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:04,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:04,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:04,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:04,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:04,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:04,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:04,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,968 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:04,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:04,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:04,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:04,970 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,970 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,971 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:04,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:04,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:04,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:04,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,972 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:04,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:04,972 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:04,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:04,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:04,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:04,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:04,973 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:04,974 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:04,974 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:05,401 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010165fd659a035e45d28ad018397b0b5f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010165fd659a035e45d28ad018397b0b5f34 2023-02-09 17:54:05,808 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4a10a592d74f491d82ac75f2d4b3e656 2023-02-09 17:54:05,816 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4a10a592d74f491d82ac75f2d4b3e656 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656 2023-02-09 17:54:05,823 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 17:54:05,824 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 850ms, sequenceid=29, compaction requested=true 2023-02-09 17:54:05,824 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:05,824 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:05,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:05,828 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,828 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:05,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:05,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c69d269[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:05,831 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:05,831 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,832 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:05,833 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,833 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:05,836 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:05,836 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:05,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,836 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:05,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:05,841 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:05,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:05,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:05,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,841 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:05,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:05,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:05,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:05,844 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:05,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,846 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:05,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,850 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:05,850 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:05,850 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:05,850 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,850 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:05,850 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:05,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:05,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:05,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:05,852 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:05,852 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:05,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:05,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:05,952 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:05,952 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:05,953 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:05,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:05,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:05,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:05,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:05,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,972 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:05,972 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:05,973 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:05,973 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:05,973 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,973 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,975 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,975 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:05,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:05,975 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:05,975 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,979 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:05,979 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:05,979 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:05,979 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:05,980 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:05,980 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:05,980 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:05,980 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:05,980 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:05,980 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:06,396 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eab2bc386da948af807215499bd9eaa6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103eab2bc386da948af807215499bd9eaa6 2023-02-09 17:54:06,805 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4a827036f1ec4fb2a8fc3a3b4a473e85 2023-02-09 17:54:06,811 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/4a827036f1ec4fb2a8fc3a3b4a473e85 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85 2023-02-09 17:54:06,816 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 17:54:06,817 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 837ms, sequenceid=33, compaction requested=true 2023-02-09 17:54:06,817 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:06,817 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:06,817 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:06,819 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,819 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:06,820 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:06,820 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:06,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:06,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c784aa[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:06,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:06,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,823 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,824 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:06,824 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:06,824 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:06,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:06,829 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,829 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:06,829 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:06,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:06,829 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:06,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:06,832 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:06,832 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:06,832 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:06,832 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,832 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:06,834 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,834 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,834 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:06,835 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:06,836 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,838 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:06,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:06,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:06,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,839 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,839 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:06,839 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:06,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:06,839 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:06,839 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:06,939 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:06,940 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:06,940 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:06,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:06,945 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:06,945 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:06,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,949 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:06,949 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:06,950 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:06,950 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:06,950 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,950 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,953 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:06,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:06,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:06,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,954 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,954 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:06,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:06,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:06,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:06,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:06,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:06,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:06,955 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:06,955 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:06,955 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:06,975 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076c929409bf524a0e9f2db939bd2d6925 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509076c929409bf524a0e9f2db939bd2d6925 2023-02-09 17:54:07,382 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/16e5df5883c24180a0417ab16be9d717 2023-02-09 17:54:07,388 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/16e5df5883c24180a0417ab16be9d717 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717 2023-02-09 17:54:07,394 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 17:54:07,395 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 440ms, sequenceid=37, compaction requested=true 2023-02-09 17:54:07,396 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:07,396 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:07,396 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:07,396 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:07,396 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,396 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:07,396 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:07,398 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,398 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,398 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,398 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:07,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df38806[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:07,400 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:07,400 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,401 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:07,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:07,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:07,401 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,401 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:07,403 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,403 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,403 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:07,403 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:07,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:07,407 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:07,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:07,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:07,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,407 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:07,410 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,410 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,410 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,411 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,412 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:07,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:07,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,415 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:07,416 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:07,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:07,416 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,416 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:07,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:07,516 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:07,516 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:07,517 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:07,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:07,522 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:07,522 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:07,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:07,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:07,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,525 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:07,525 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:07,526 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:54:07,526 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:07,526 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,526 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,527 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:07,527 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:07,528 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,528 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:07,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,529 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:54:07,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,529 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:54:07,529 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:07,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:54:07,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:07,530 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:07,531 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:07,531 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. started... 2023-02-09 17:54:07,531 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d34b4f06061d789d27ca604cbf3df18 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:07,950 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201cb0bf99bd3a4d08b8ddb0982570d677 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201cb0bf99bd3a4d08b8ddb0982570d677 2023-02-09 17:54:07,956 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/657c7d3db4ac436fa65f191321f84778 2023-02-09 17:54:07,963 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/657c7d3db4ac436fa65f191321f84778 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778 2023-02-09 17:54:07,968 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 17:54:07,970 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d34b4f06061d789d27ca604cbf3df18 in 439ms, sequenceid=41, compaction requested=true 2023-02-09 17:54:07,970 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:07,970 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:07,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:07,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:07,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:54:07,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:54:07,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,972 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:54:07,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48281ac6[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:07,974 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:07,974 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,976 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:54:07,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:07,977 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,977 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:07,978 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:07,978 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:07,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:07,982 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:54:07,982 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:07,982 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:07,982 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,982 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:07,985 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,985 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,985 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:07,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,985 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:07,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:07,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:07,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,990 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:07,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 17:54:07,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:07,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:07,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:07,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:54:07,992 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:07,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:07,991 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:07,992 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:07,992 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,992 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,992 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:07,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:07,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:08,092 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:08,092 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:08,092 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:08,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:08,095 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-09 17:54:08,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:08,098 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:08,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:08,099 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965848099 2023-02-09 17:54:08,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:08,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 17:54:08,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:08,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x4e2ab712 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:08,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e6835ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:08,116 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:08,980 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039dad9cffd8874b81a402bfaa96e6e51e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039dad9cffd8874b81a402bfaa96e6e51e 2023-02-09 17:54:08,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:08,997 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:08,998 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:09,007 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:09,007 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:09,008 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:09,009 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:09,022 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2c890b6702e44a77a6724ed90379f443 first=Optional[r5] last=Optional[r6] 2023-02-09 17:54:09,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2c890b6702e44a77a6724ed90379f443}] 2023-02-09 17:54:09,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2c890b6702e44a77a6724ed90379f443 for inclusion in 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 17:54:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:09,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/2c890b6702e44a77a6724ed90379f443 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__spgjd0dl66c43h2jp4495qbuu66036ik89mi9hdaemmvjatddkpf43rsv97gqmjr/family1/2c890b6702e44a77a6724ed90379f443 2023-02-09 17:54:09,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__spgjd0dl66c43h2jp4495qbuu66036ik89mi9hdaemmvjatddkpf43rsv97gqmjr/family1/2c890b6702e44a77a6724ed90379f443 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_ 2023-02-09 17:54:09,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__spgjd0dl66c43h2jp4495qbuu66036ik89mi9hdaemmvjatddkpf43rsv97gqmjr/family1/2c890b6702e44a77a6724ed90379f443 into 0d34b4f06061d789d27ca604cbf3df18/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_ - updating store file list. 2023-02-09 17:54:09,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_ into 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:09,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__spgjd0dl66c43h2jp4495qbuu66036ik89mi9hdaemmvjatddkpf43rsv97gqmjr/family1/2c890b6702e44a77a6724ed90379f443 into 0d34b4f06061d789d27ca604cbf3df18/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_) 2023-02-09 17:54:09,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__spgjd0dl66c43h2jp4495qbuu66036ik89mi9hdaemmvjatddkpf43rsv97gqmjr/family1/2c890b6702e44a77a6724ed90379f443 2023-02-09 17:54:09,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:54:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:54:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 0d34b4f06061d789d27ca604cbf3df18/family1 is initiating minor compaction 2023-02-09 17:54:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44e86252; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:09,047 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0d34b4f06061d789d27ca604cbf3df18/family1 in testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:09,047 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp, totalSize=49.7 K 2023-02-09 17:54:09,047 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 9da3157b33324b19b2849b9133d18a83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 4663990e4e274f4b8fd72750a3516170, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 0053015d1e4f46e89e6c68963c07565f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 619d390660c743c7b1fd9d731cdcc6b9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a88e5e31e474412cba4441103efec428, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 4a10a592d74f491d82ac75f2d4b3e656, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 4a827036f1ec4fb2a8fc3a3b4a473e85, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 16e5df5883c24180a0417ab16be9d717, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 657c7d3db4ac436fa65f191321f84778, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:54:09,048 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 133018d831e946d0898674bb6cfa5480_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:54:09,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:09,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:09,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010165fd659a035e45d28ad018397b0b5f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010165fd659a035e45d28ad018397b0b5f34 2023-02-09 17:54:09,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103eab2bc386da948af807215499bd9eaa6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103eab2bc386da948af807215499bd9eaa6 2023-02-09 17:54:09,055 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 17:54:09,055 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 17:54:09,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:09,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:09,100 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d34b4f06061d789d27ca604cbf3df18#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:09,923 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/aefd11bae77d48f19f536002be0b8f3c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/aefd11bae77d48f19f536002be0b8f3c 2023-02-09 17:54:09,927 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316a538e6ce4f84aafa83f929547e824e7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512316a538e6ce4f84aafa83f929547e824e7 2023-02-09 17:54:09,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:09,931 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0d34b4f06061d789d27ca604cbf3df18/family1 of 0d34b4f06061d789d27ca604cbf3df18 into aefd11bae77d48f19f536002be0b8f3c(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:09,931 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:09,932 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675965249047; duration=0sec 2023-02-09 17:54:09,932 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:09,949 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:09,949 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:09,960 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f1875b47adcb4d7ca6b2457896afb085 first=Optional[r1] last=Optional[r4] 2023-02-09 17:54:09,960 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f1875b47adcb4d7ca6b2457896afb085}] 2023-02-09 17:54:09,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f1875b47adcb4d7ca6b2457896afb085 for inclusion in 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:09,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 17:54:09,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:09,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:09,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f1875b47adcb4d7ca6b2457896afb085 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5fj7v3052nqkofn04c7tr31sl03o4o014smprgkdr3l3heers3s74tql0124cpn/family1/f1875b47adcb4d7ca6b2457896afb085 2023-02-09 17:54:10,029 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:10,029 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ddd57b7 to 127.0.0.1:59572 2023-02-09 17:54:10,029 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:10,040 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:10,040 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x267403d3 to 127.0.0.1:59572 2023-02-09 17:54:10,041 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:10,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_] to archive 2023-02-09 17:54:10,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5fj7v3052nqkofn04c7tr31sl03o4o014smprgkdr3l3heers3s74tql0124cpn/family1/f1875b47adcb4d7ca6b2457896afb085 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_ 2023-02-09 17:54:10,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:10,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5fj7v3052nqkofn04c7tr31sl03o4o014smprgkdr3l3heers3s74tql0124cpn/family1/f1875b47adcb4d7ca6b2457896afb085 into 0d34b4f06061d789d27ca604cbf3df18/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_ - updating store file list. 2023-02-09 17:54:10,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/9da3157b33324b19b2849b9133d18a83 2023-02-09 17:54:10,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4663990e4e274f4b8fd72750a3516170 2023-02-09 17:54:10,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0053015d1e4f46e89e6c68963c07565f 2023-02-09 17:54:10,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_ into 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:10,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5fj7v3052nqkofn04c7tr31sl03o4o014smprgkdr3l3heers3s74tql0124cpn/family1/f1875b47adcb4d7ca6b2457896afb085 into 0d34b4f06061d789d27ca604cbf3df18/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_) 2023-02-09 17:54:10,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g5fj7v3052nqkofn04c7tr31sl03o4o014smprgkdr3l3heers3s74tql0124cpn/family1/f1875b47adcb4d7ca6b2457896afb085 2023-02-09 17:54:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:54:10,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/619d390660c743c7b1fd9d731cdcc6b9 2023-02-09 17:54:10,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:54:10,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 0d34b4f06061d789d27ca604cbf3df18/family1 is initiating minor compaction (all files) 2023-02-09 17:54:10,058 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0d34b4f06061d789d27ca604cbf3df18/family1 in testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:54:10,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@332ee777; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:10,058 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/aefd11bae77d48f19f536002be0b8f3c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp, totalSize=178.1 K 2023-02-09 17:54:10,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/a88e5e31e474412cba4441103efec428 2023-02-09 17:54:10,059 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c7413969e36a41e7a6cc9b9a831d8402, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:54:10,060 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting aefd11bae77d48f19f536002be0b8f3c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:54:10,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a10a592d74f491d82ac75f2d4b3e656 2023-02-09 17:54:10,060 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting d0e82d43f36b4c919f3dc604017201b6_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242209 2023-02-09 17:54:10,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:10,062 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:10,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/4a827036f1ec4fb2a8fc3a3b4a473e85 2023-02-09 17:54:10,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/16e5df5883c24180a0417ab16be9d717 2023-02-09 17:54:10,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015c7309bc14f641a0b03beb34b43bb08c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015c7309bc14f641a0b03beb34b43bb08c 2023-02-09 17:54:10,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/657c7d3db4ac436fa65f191321f84778 2023-02-09 17:54:10,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/133018d831e946d0898674bb6cfa5480_SeqId_44_ 2023-02-09 17:54:10,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053b32fdd1800647c389232547b8d60666 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053b32fdd1800647c389232547b8d60666 2023-02-09 17:54:10,074 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282d1f6074785548cfa348df2187419e78 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282d1f6074785548cfa348df2187419e78 2023-02-09 17:54:10,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314b3e5516217044258059d2af4f50444c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314b3e5516217044258059d2af4f50444c 2023-02-09 17:54:10,075 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 17:54:10,075 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 17:54:10,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:10,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:10,122 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d34b4f06061d789d27ca604cbf3df18#family1#compaction#23 average throughput is 8.64 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:10,165 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f6f265b32c9845109770c51010b2dcd0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f6f265b32c9845109770c51010b2dcd0 2023-02-09 17:54:10,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:10,188 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:10,189 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:10,211 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/174b9dd19f7945b2bafc7a48f5838faf first=Optional[r00] last=Optional[r8] 2023-02-09 17:54:10,212 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/174b9dd19f7945b2bafc7a48f5838faf}] 2023-02-09 17:54:10,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/174b9dd19f7945b2bafc7a48f5838faf for inclusion in 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 17:54:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:10,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/174b9dd19f7945b2bafc7a48f5838faf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9cs2ice194tjlfg5a3v6r80tqrbjt839lljvg7do928n71tet60nm0jb392ou589/family1/174b9dd19f7945b2bafc7a48f5838faf 2023-02-09 17:54:10,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9cs2ice194tjlfg5a3v6r80tqrbjt839lljvg7do928n71tet60nm0jb392ou589/family1/174b9dd19f7945b2bafc7a48f5838faf as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0555cf1138d1431e9ab8c18c51361ab4_SeqId_49_ 2023-02-09 17:54:10,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9cs2ice194tjlfg5a3v6r80tqrbjt839lljvg7do928n71tet60nm0jb392ou589/family1/174b9dd19f7945b2bafc7a48f5838faf into 0d34b4f06061d789d27ca604cbf3df18/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0555cf1138d1431e9ab8c18c51361ab4_SeqId_49_ - updating store file list. 2023-02-09 17:54:10,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0555cf1138d1431e9ab8c18c51361ab4_SeqId_49_ into 0d34b4f06061d789d27ca604cbf3df18/family1 2023-02-09 17:54:10,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9cs2ice194tjlfg5a3v6r80tqrbjt839lljvg7do928n71tet60nm0jb392ou589/family1/174b9dd19f7945b2bafc7a48f5838faf into 0d34b4f06061d789d27ca604cbf3df18/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/0555cf1138d1431e9ab8c18c51361ab4_SeqId_49_) 2023-02-09 17:54:10,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9cs2ice194tjlfg5a3v6r80tqrbjt839lljvg7do928n71tet60nm0jb392ou589/family1/174b9dd19f7945b2bafc7a48f5838faf 2023-02-09 17:54:10,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:10,236 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:10,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201cb0bf99bd3a4d08b8ddb0982570d677 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201cb0bf99bd3a4d08b8ddb0982570d677 2023-02-09 17:54:10,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab64060095bc4644afb5a8c8a314949c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ab64060095bc4644afb5a8c8a314949c 2023-02-09 17:54:10,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130424da2fbaceb4791a7da01793f91ba4a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130424da2fbaceb4791a7da01793f91ba4a 2023-02-09 17:54:10,241 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 17:54:10,241 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 17:54:10,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:10,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:10,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:54:10,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:54:10,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:10,243 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:10,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.1470 sec 2023-02-09 17:54:10,378 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253 (was 249) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46092 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1020131656_15 at /127.0.0.1:46370 [Receiving block BP-2080551098-172.31.14.131-1675965213977:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x4e2ab712 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1791735639.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46352 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46356 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/91ed18ffe7794df0895a129a5b968469 block BP-2080551098-172.31.14.131-1675965213977:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x4e2ab712-SendThread(127.0.0.1:59572) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46244 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46184 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4b8d35e0-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46174 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46304 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46142 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59572@0x4e2ab712-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313542a889322c448a82262faa67eee4c8_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46288 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46252 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46200 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12e4b88d-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-2080551098-172.31.14.131-1675965213977:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46108 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-481 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: PacketResponder: BP-2080551098-172.31.14.131-1675965213977:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902151818_15 at /127.0.0.1:46260 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 590), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 285), ProcessCount=168 (was 168), AvailableMemoryMB=3442 (was 4014) 2023-02-09 17:54:10,395 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=168, AvailableMemoryMB=3442 2023-02-09 17:54:10,396 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:10,396 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:10,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:54:10,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:10,402 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:54:10,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-09 17:54:10,403 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:54:10,403 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:10,403 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:10,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 17:54:10,407 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,408 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8 empty. 2023-02-09 17:54:10,408 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-09 17:54:10,421 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:10,423 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 54752fc19d09f992050698d1229355c8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:10,430 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:10,430 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 54752fc19d09f992050698d1229355c8, disabling compactions & flushes 2023-02-09 17:54:10,430 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,430 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,431 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. after waiting 0 ms 2023-02-09 17:54:10,431 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,431 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,431 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 54752fc19d09f992050698d1229355c8: Waiting for close lock at 1675965250430Disabling compacts and flushes for region at 1675965250430Disabling writes for close at 1675965250431 (+1 ms)Writing region close event to WAL at 1675965250431Closed at 1675965250431 2023-02-09 17:54:10,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:54:10,434 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965250434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965250434"}]},"ts":"1675965250434"} 2023-02-09 17:54:10,436 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:54:10,437 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:54:10,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965250437"}]},"ts":"1675965250437"} 2023-02-09 17:54:10,439 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 17:54:10,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=54752fc19d09f992050698d1229355c8, ASSIGN}] 2023-02-09 17:54:10,448 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=54752fc19d09f992050698d1229355c8, ASSIGN 2023-02-09 17:54:10,449 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=54752fc19d09f992050698d1229355c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:10,505 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:10,505 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:10,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 17:54:10,600 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=54752fc19d09f992050698d1229355c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:10,600 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965250600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965250600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965250600"}]},"ts":"1675965250600"} 2023-02-09 17:54:10,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 54752fc19d09f992050698d1229355c8, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:10,706 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:10,707 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:10,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 17:54:10,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 54752fc19d09f992050698d1229355c8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:10,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:10,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,760 INFO [StoreOpener-54752fc19d09f992050698d1229355c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,762 DEBUG [StoreOpener-54752fc19d09f992050698d1229355c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:10,762 DEBUG [StoreOpener-54752fc19d09f992050698d1229355c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:10,762 INFO [StoreOpener-54752fc19d09f992050698d1229355c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54752fc19d09f992050698d1229355c8 columnFamilyName family1 2023-02-09 17:54:10,764 INFO [StoreOpener-54752fc19d09f992050698d1229355c8-1] regionserver.HStore(310): Store=54752fc19d09f992050698d1229355c8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 54752fc19d09f992050698d1229355c8 2023-02-09 17:54:10,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:10,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 54752fc19d09f992050698d1229355c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74716653, jitterRate=0.11336489021778107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:10,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 54752fc19d09f992050698d1229355c8: Running coprocessor pre-open hook at 1675965250759Writing region info on filesystem at 1675965250759Initializing all the Stores at 1675965250760 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965250760Cleaning up temporary data from old regions at 1675965250766 (+6 ms)Cleaning up detritus from prior splits at 1675965250766Running coprocessor post-open hooks at 1675965250771 (+5 ms)Region opened successfully at 1675965250771 2023-02-09 17:54:10,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8., pid=25, masterSystemTime=1675965250754 2023-02-09 17:54:10,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:10,774 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=54752fc19d09f992050698d1229355c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:10,775 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965250774"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965250774"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965250774"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965250774"}]},"ts":"1675965250774"} 2023-02-09 17:54:10,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-09 17:54:10,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 54752fc19d09f992050698d1229355c8, server=jenkins-hbase4.apache.org,42581,1675965218218 in 174 msec 2023-02-09 17:54:10,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-09 17:54:10,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=54752fc19d09f992050698d1229355c8, ASSIGN in 332 msec 2023-02-09 17:54:10,781 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:54:10,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965250781"}]},"ts":"1675965250781"} 2023-02-09 17:54:10,783 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 17:54:10,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:54:10,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 387 msec 2023-02-09 17:54:10,964 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/.tmp/family1/91ed18ffe7794df0895a129a5b968469 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/91ed18ffe7794df0895a129a5b968469 2023-02-09 17:54:10,971 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0d34b4f06061d789d27ca604cbf3df18/family1 of 0d34b4f06061d789d27ca604cbf3df18 into 91ed18ffe7794df0895a129a5b968469(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:10,971 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0d34b4f06061d789d27ca604cbf3df18: 2023-02-09 17:54:10,971 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675965250057; duration=0sec 2023-02-09 17:54:10,972 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:11,008 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,008 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 17:54:11,009 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-09 17:54:11,033 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,034 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:11,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,036 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,036 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,036 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:11,036 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:11,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,038 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,038 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,039 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,039 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,044 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:11,044 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,044 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:11,044 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:11,044 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,044 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:11,044 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:11,045 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:54:11,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/aefd11bae77d48f19f536002be0b8f3c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_] to archive 2023-02-09 17:54:11,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:11,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/c7413969e36a41e7a6cc9b9a831d8402 2023-02-09 17:54:11,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/aefd11bae77d48f19f536002be0b8f3c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/aefd11bae77d48f19f536002be0b8f3c 2023-02-09 17:54:11,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/family1/d0e82d43f36b4c919f3dc604017201b6_SeqId_47_ 2023-02-09 17:54:11,081 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f0cf6c1c4adb46a995f7131db07085fc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130f0cf6c1c4adb46a995f7131db07085fc 2023-02-09 17:54:11,085 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/8a0018fd98ec4244885c168b45e78cdf 2023-02-09 17:54:11,091 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/8a0018fd98ec4244885c168b45e78cdf as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/8a0018fd98ec4244885c168b45e78cdf 2023-02-09 17:54:11,096 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/8a0018fd98ec4244885c168b45e78cdf, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 17:54:11,098 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 52ms, sequenceid=5, compaction requested=false 2023-02-09 17:54:11,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:11,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:11,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:11,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:11,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:11,100 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,100 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a607330[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:11,102 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:11,103 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,105 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,106 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:11,106 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:11,106 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:11,110 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,110 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:11,114 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,114 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:11,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:11,118 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:11,118 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:11,118 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:11,118 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,118 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:11,121 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,121 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,125 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,125 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,129 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,134 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,135 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:11,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:11,135 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:11,236 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:11,236 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,236 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:11,241 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,242 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:11,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:11,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,244 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,244 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,244 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:11,244 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:11,245 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,245 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,248 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,248 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,249 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,249 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:11,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,250 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:11,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,250 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:11,251 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:11,251 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:11,251 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,251 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:11,251 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:54:11,270 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cbe4f0ed4e9a454099be1bff71de2247 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128cbe4f0ed4e9a454099be1bff71de2247 2023-02-09 17:54:11,282 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/0caaa72fc8ca467fa9d4e885407029ac 2023-02-09 17:54:11,290 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/0caaa72fc8ca467fa9d4e885407029ac as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac 2023-02-09 17:54:11,298 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:11,299 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 48ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:11,300 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:11,300 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:11,300 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:11,302 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,302 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:11,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25dd5a02[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:11,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:11,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,306 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:11,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:11,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:11,308 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:11,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:11,311 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:11,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:11,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:11,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,311 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:11,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,317 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,319 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:11,323 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,323 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,324 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:11,324 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:11,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:11,424 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:11,424 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,424 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:11,432 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:11,432 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:11,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:11,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:11,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,438 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,438 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,438 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:11,438 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:11,438 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,438 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,441 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,441 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,441 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,441 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:11,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:11,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:11,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:11,457 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:11,457 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:11,457 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,457 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:11,457 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:11,874 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f0c470267bc84a9fb0574deecc2cdc4e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f0c470267bc84a9fb0574deecc2cdc4e 2023-02-09 17:54:11,886 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/5b4f1abfbc064dac8fc033e5b49a0681 2023-02-09 17:54:11,892 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/5b4f1abfbc064dac8fc033e5b49a0681 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681 2023-02-09 17:54:11,898 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 17:54:11,899 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 442ms, sequenceid=13, compaction requested=true 2023-02-09 17:54:11,899 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:11,899 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:11,899 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:11,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:11,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:11,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:11,902 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,902 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,902 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,902 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:11,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:11,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@541f4507[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:11,904 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:11,904 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,912 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,912 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:11,912 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:11,912 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:11,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:11,914 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,914 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:11,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,914 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,914 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:11,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:11,917 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:11,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:11,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:11,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,917 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:11,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:11,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:11,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:11,919 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,921 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:11,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:11,927 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:11,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:11,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:11,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:11,928 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:11,928 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:11,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:12,028 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:12,028 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:12,028 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:12,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:12,034 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:12,034 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:12,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:12,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:12,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,037 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:12,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:12,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:12,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:12,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,037 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,039 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,039 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:12,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:12,039 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,039 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,040 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:12,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:12,041 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:12,041 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:12,041 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:12,041 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:12,456 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205efb97c9f3d724fdd981649c2788ca912 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205efb97c9f3d724fdd981649c2788ca912 2023-02-09 17:54:12,862 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/a8025e1fda884d92980df7746c4488bc 2023-02-09 17:54:12,868 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/a8025e1fda884d92980df7746c4488bc as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc 2023-02-09 17:54:12,873 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 17:54:12,874 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 833ms, sequenceid=17, compaction requested=true 2023-02-09 17:54:12,875 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:12,875 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:12,877 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ce98b68[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:12,880 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:12,880 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,881 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:12,882 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,882 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:12,884 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,884 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:12,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:12,885 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:12,887 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:12,888 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:12,888 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:12,888 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,888 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:12,890 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,890 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:12,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,890 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:12,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:12,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:12,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:12,891 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,893 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:12,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,895 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:12,895 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,895 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:12,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:12,895 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:12,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:12,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:12,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:12,895 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:12,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:12,996 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:12,996 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:12,996 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:12,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:13,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:13,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:13,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:13,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:13,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,003 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:13,003 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:13,003 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:13,003 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:13,004 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,004 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,005 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:13,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:13,005 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:13,005 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,006 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,007 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:13,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:13,007 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:13,007 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:13,007 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:13,420 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228715c75a8b2404b6f9e71bd0bd1857130 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228715c75a8b2404b6f9e71bd0bd1857130 2023-02-09 17:54:13,826 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/e0062b0b8aec4e0db6f9f8570803d99f 2023-02-09 17:54:13,832 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/e0062b0b8aec4e0db6f9f8570803d99f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f 2023-02-09 17:54:13,838 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 17:54:13,839 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 832ms, sequenceid=21, compaction requested=true 2023-02-09 17:54:13,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:13,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:13,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:13,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:13,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:13,840 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:13,841 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:13,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:13,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:13,842 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:13,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:13,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:13,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e99a36[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:13,844 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:13,844 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,846 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:13,846 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,846 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:13,848 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:13,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:13,852 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:13,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:13,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:13,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,852 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:13,855 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,855 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:13,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,855 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:13,855 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,857 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:13,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,860 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:13,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:13,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:13,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:13,861 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:13,861 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:13,961 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:13,961 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:13,961 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:13,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:13,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:13,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:13,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,969 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:13,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:13,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:13,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:13,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,971 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:13,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:13,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,971 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:13,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,972 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:13,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:13,972 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:13,972 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:13,972 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:13,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:13,973 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:13,973 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:13,973 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:13,973 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:14,386 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d2f16cdb941f4c19bc1dddb1ed151fae to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2f16cdb941f4c19bc1dddb1ed151fae 2023-02-09 17:54:14,792 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/da9f3d314a4c43e58aa8586ceafad403 2023-02-09 17:54:14,797 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/da9f3d314a4c43e58aa8586ceafad403 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403 2023-02-09 17:54:14,802 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 17:54:14,803 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 830ms, sequenceid=25, compaction requested=true 2023-02-09 17:54:14,803 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:14,803 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:14,803 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,804 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:14,804 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:14,805 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:14,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:14,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:14,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:14,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6aabd9c3[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:14,807 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:14,807 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,809 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:14,809 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:14,809 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,809 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:14,813 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:14,813 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,813 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,813 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:14,815 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:14,816 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:14,816 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:14,816 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,816 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:14,817 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,817 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:14,817 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:14,817 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,819 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:14,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:14,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:14,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,822 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:14,823 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:14,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:14,923 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:14,923 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:14,923 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:14,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:14,928 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:14,928 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:14,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:14,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:14,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,930 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:14,930 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:14,930 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:14,931 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:14,931 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,931 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,932 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,932 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:14,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:14,933 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:14,933 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:14,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:14,934 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:14,934 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:14,934 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:15,350 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d3258c15d8b9487d98cc1181123977ea to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d3258c15d8b9487d98cc1181123977ea 2023-02-09 17:54:15,756 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/da028f5171d34b11b8499edde42200e8 2023-02-09 17:54:15,763 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/da028f5171d34b11b8499edde42200e8 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8 2023-02-09 17:54:15,768 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 17:54:15,769 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 835ms, sequenceid=29, compaction requested=true 2023-02-09 17:54:15,769 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:15,769 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:15,769 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:15,769 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:15,769 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,769 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:15,769 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:15,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:15,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:15,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:15,772 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,772 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:15,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:15,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:15,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b29eec[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:15,774 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:15,774 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,775 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:15,775 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:15,775 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,775 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:15,778 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:15,778 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,778 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:15,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:15,778 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:15,781 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:15,781 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:15,781 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:15,781 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,781 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:15,783 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,783 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:15,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,783 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:15,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:15,784 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,785 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:15,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:15,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:15,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:15,788 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:15,788 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:15,889 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:15,889 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:15,889 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:15,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:15,894 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:15,894 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:15,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,896 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:15,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:15,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:15,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:15,897 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,897 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,898 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:15,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:15,899 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:15,899 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:15,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,900 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:15,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:15,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:15,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:15,900 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:16,287 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:54:16,313 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fec0d505d2394a98a6a3b95fb43cd1d8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fec0d505d2394a98a6a3b95fb43cd1d8 2023-02-09 17:54:16,720 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/c5df17745da24bd79478c3426593bd0d 2023-02-09 17:54:16,725 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/c5df17745da24bd79478c3426593bd0d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d 2023-02-09 17:54:16,730 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 17:54:16,731 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 831ms, sequenceid=33, compaction requested=true 2023-02-09 17:54:16,731 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:16,731 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:16,731 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:16,731 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:16,731 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,731 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:16,731 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:16,734 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,734 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:16,734 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,734 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:16,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:16,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5490efd9[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:16,736 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:16,736 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,737 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:16,737 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,737 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:16,739 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:16,739 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:16,739 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,739 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:16,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:16,741 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:16,741 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:16,741 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:16,741 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,741 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:16,743 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,743 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:16,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,743 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:16,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:16,744 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,748 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,748 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:16,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:16,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:16,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:16,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:16,748 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:16,748 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:16,748 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,749 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:16,849 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:16,849 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:16,849 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:16,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:16,854 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:16,854 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:16,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:16,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:16,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,857 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:16,857 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:16,857 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:16,857 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:16,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:16,859 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:16,860 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:16,860 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,862 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:16,862 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:16,863 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:16,863 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:17,285 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d8247a10185c4470b57fb930c9101ba2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907d8247a10185c4470b57fb930c9101ba2 2023-02-09 17:54:17,698 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/c398c3abceed4a18956f3cd04bb8d7f5 2023-02-09 17:54:17,704 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/c398c3abceed4a18956f3cd04bb8d7f5 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5 2023-02-09 17:54:17,709 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 17:54:17,710 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 847ms, sequenceid=37, compaction requested=true 2023-02-09 17:54:17,710 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:17,710 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:17,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:17,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:17,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:17,710 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:17,713 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:17,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:17,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dc1e757[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:17,715 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:17,715 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,721 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:17,721 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,721 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:17,723 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,723 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:17,723 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:17,723 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:17,725 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:17,725 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:17,725 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:17,726 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,726 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:17,727 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,727 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:17,727 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:17,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:17,728 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:17,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,729 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:17,733 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:17,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:17,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:17,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:17,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:17,733 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:17,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:17,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:17,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:17,834 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:17,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:17,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:17,838 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:17,839 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:17,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:17,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:17,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,841 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:17,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:17,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:17,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:17,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:17,843 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:17,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:17,843 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:17,843 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:17,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:17,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,844 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,844 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:17,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:17,844 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:17,844 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:17,844 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:17,844 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:17,844 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:17,844 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:17,844 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. started... 2023-02-09 17:54:17,845 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 54752fc19d09f992050698d1229355c8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:18,263 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201084cad1331d4c6fa5db1b8fe28d614d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511201084cad1331d4c6fa5db1b8fe28d614d 2023-02-09 17:54:18,670 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/9d014877b3714c818531a0a33627aa05 2023-02-09 17:54:18,675 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/9d014877b3714c818531a0a33627aa05 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05 2023-02-09 17:54:18,680 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 17:54:18,681 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 54752fc19d09f992050698d1229355c8 in 836ms, sequenceid=41, compaction requested=true 2023-02-09 17:54:18,681 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:18,681 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:18,682 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,682 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:18,683 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,683 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:18,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:18,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@99054ed[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:18,684 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:18,684 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,685 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:18,685 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,685 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:18,687 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:18,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:18,689 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:18,689 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:18,689 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:18,689 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,689 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:18,691 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,691 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,691 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:18,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:18,692 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,693 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 17:54:18,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:18,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:18,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:18,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:18,696 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:18,695 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:18,696 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:18,696 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:18,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:18,696 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,696 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,796 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:18,796 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:18,796 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:18,799 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-09 17:54:18,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:18,802 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:18,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:18,804 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965858804 2023-02-09 17:54:18,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:54:18,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 17:54:18,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x0ebaaac9 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:18,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17013d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:18,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,672 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032c09914fea34413ab571d59fcb40c075 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601032c09914fea34413ab571d59fcb40c075 2023-02-09 17:54:19,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:19,686 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:19,687 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:19,694 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:19,694 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:19,694 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:19,696 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52058, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:19,705 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2c01ef321a8446cbb6f2cf1f93dc852e first=Optional[r3] last=Optional[r6] 2023-02-09 17:54:19,706 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2c01ef321a8446cbb6f2cf1f93dc852e}] 2023-02-09 17:54:19,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2c01ef321a8446cbb6f2cf1f93dc852e for inclusion in 54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 17:54:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:19,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2c01ef321a8446cbb6f2cf1f93dc852e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__q5gv04uunfuovmbm7c1mldaqff96q90nb9868qcqojqo6dhrj5174edvqgpku0v8/family1/2c01ef321a8446cbb6f2cf1f93dc852e 2023-02-09 17:54:19,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__q5gv04uunfuovmbm7c1mldaqff96q90nb9868qcqojqo6dhrj5174edvqgpku0v8/family1/2c01ef321a8446cbb6f2cf1f93dc852e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_ 2023-02-09 17:54:19,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__q5gv04uunfuovmbm7c1mldaqff96q90nb9868qcqojqo6dhrj5174edvqgpku0v8/family1/2c01ef321a8446cbb6f2cf1f93dc852e into 54752fc19d09f992050698d1229355c8/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_ - updating store file list. 2023-02-09 17:54:19,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_ into 54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:19,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__q5gv04uunfuovmbm7c1mldaqff96q90nb9868qcqojqo6dhrj5174edvqgpku0v8/family1/2c01ef321a8446cbb6f2cf1f93dc852e into 54752fc19d09f992050698d1229355c8/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_) 2023-02-09 17:54:19,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__q5gv04uunfuovmbm7c1mldaqff96q90nb9868qcqojqo6dhrj5174edvqgpku0v8/family1/2c01ef321a8446cbb6f2cf1f93dc852e 2023-02-09 17:54:19,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:54:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:54:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 54752fc19d09f992050698d1229355c8/family1 is initiating minor compaction 2023-02-09 17:54:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6b6a451; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:19,727 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 54752fc19d09f992050698d1229355c8/family1 in testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:54:19,727 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp, totalSize=50.0 K 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 0caaa72fc8ca467fa9d4e885407029ac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 5b4f1abfbc064dac8fc033e5b49a0681, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a8025e1fda884d92980df7746c4488bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting e0062b0b8aec4e0db6f9f8570803d99f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting da9f3d314a4c43e58aa8586ceafad403, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:54:19,727 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting da028f5171d34b11b8499edde42200e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:54:19,728 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c5df17745da24bd79478c3426593bd0d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:54:19,728 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c398c3abceed4a18956f3cd04bb8d7f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:54:19,728 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 9d014877b3714c818531a0a33627aa05, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:54:19,728 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:54:19,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:19,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:19,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228715c75a8b2404b6f9e71bd0bd1857130 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228715c75a8b2404b6f9e71bd0bd1857130 2023-02-09 17:54:19,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2f16cdb941f4c19bc1dddb1ed151fae to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2f16cdb941f4c19bc1dddb1ed151fae 2023-02-09 17:54:19,734 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d3258c15d8b9487d98cc1181123977ea to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d3258c15d8b9487d98cc1181123977ea 2023-02-09 17:54:19,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fec0d505d2394a98a6a3b95fb43cd1d8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fec0d505d2394a98a6a3b95fb43cd1d8 2023-02-09 17:54:19,736 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 17:54:19,736 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,782 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 54752fc19d09f992050698d1229355c8#family1#compaction#34 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:19,800 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c8b7e3b15f6e4d2da7586a301499cdda to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c8b7e3b15f6e4d2da7586a301499cdda 2023-02-09 17:54:19,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:19,820 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:19,820 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:19,830 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8860b3d2d3b74bda8edfc3a6a60498a6 first=Optional[r1] last=Optional[r2] 2023-02-09 17:54:19,831 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8860b3d2d3b74bda8edfc3a6a60498a6}] 2023-02-09 17:54:19,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8860b3d2d3b74bda8edfc3a6a60498a6 for inclusion in 54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:19,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 17:54:19,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:19,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:19,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8860b3d2d3b74bda8edfc3a6a60498a6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m0qi608ntv1glb5rslj9euricmvqu21blu3kkl83mhmp6rntlqub5l3hi3s08m5n/family1/8860b3d2d3b74bda8edfc3a6a60498a6 2023-02-09 17:54:19,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m0qi608ntv1glb5rslj9euricmvqu21blu3kkl83mhmp6rntlqub5l3hi3s08m5n/family1/8860b3d2d3b74bda8edfc3a6a60498a6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/6f47e4e7de54451eaff11401cbac3d6e_SeqId_46_ 2023-02-09 17:54:19,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m0qi608ntv1glb5rslj9euricmvqu21blu3kkl83mhmp6rntlqub5l3hi3s08m5n/family1/8860b3d2d3b74bda8edfc3a6a60498a6 into 54752fc19d09f992050698d1229355c8/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/6f47e4e7de54451eaff11401cbac3d6e_SeqId_46_ - updating store file list. 2023-02-09 17:54:19,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/6f47e4e7de54451eaff11401cbac3d6e_SeqId_46_ into 54752fc19d09f992050698d1229355c8/family1 2023-02-09 17:54:19,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m0qi608ntv1glb5rslj9euricmvqu21blu3kkl83mhmp6rntlqub5l3hi3s08m5n/family1/8860b3d2d3b74bda8edfc3a6a60498a6 into 54752fc19d09f992050698d1229355c8/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/6f47e4e7de54451eaff11401cbac3d6e_SeqId_46_) 2023-02-09 17:54:19,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m0qi608ntv1glb5rslj9euricmvqu21blu3kkl83mhmp6rntlqub5l3hi3s08m5n/family1/8860b3d2d3b74bda8edfc3a6a60498a6 2023-02-09 17:54:19,852 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:19,853 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:19,855 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f0c470267bc84a9fb0574deecc2cdc4e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f0c470267bc84a9fb0574deecc2cdc4e 2023-02-09 17:54:19,856 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205efb97c9f3d724fdd981649c2788ca912 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205efb97c9f3d724fdd981649c2788ca912 2023-02-09 17:54:19,856 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-09 17:54:19,856 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 17:54:19,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:19,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:19,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:19,858 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:19,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0580 sec 2023-02-09 17:54:19,987 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258 (was 253) - Thread LEAK? -, OpenFileDescriptor=620 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 236) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3298 (was 3442) 2023-02-09 17:54:20,003 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=258, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=168, AvailableMemoryMB=3296 2023-02-09 17:54:20,004 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:20,004 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:20,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 17:54:20,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:20,010 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:54:20,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-09 17:54:20,010 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:20,011 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:20,011 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:54:20,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 17:54:20,013 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,013 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,014 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a empty. 2023-02-09 17:54:20,014 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,014 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a empty. 2023-02-09 17:54:20,014 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d empty. 2023-02-09 17:54:20,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,015 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-09 17:54:20,026 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:20,028 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => a046371abb5f5c08e5ab51af821baf0d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:20,029 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08df5076a8a74301ce9055f859f6894a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:20,029 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6f576a3c5dfc02b76d6036c8a466e70a, NAME => 'testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:20,112 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:20,112 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:20,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 17:54:20,206 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/.tmp/family1/a32ea5258c7042e68ebf36b04143b522 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a32ea5258c7042e68ebf36b04143b522 2023-02-09 17:54:20,212 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 54752fc19d09f992050698d1229355c8/family1 of 54752fc19d09f992050698d1229355c8 into a32ea5258c7042e68ebf36b04143b522(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:20,213 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 54752fc19d09f992050698d1229355c8: 2023-02-09 17:54:20,213 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675965259727; duration=0sec 2023-02-09 17:54:20,213 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:20,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_] to archive 2023-02-09 17:54:20,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:20,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/0caaa72fc8ca467fa9d4e885407029ac 2023-02-09 17:54:20,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/5b4f1abfbc064dac8fc033e5b49a0681 2023-02-09 17:54:20,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/a8025e1fda884d92980df7746c4488bc 2023-02-09 17:54:20,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/e0062b0b8aec4e0db6f9f8570803d99f 2023-02-09 17:54:20,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da9f3d314a4c43e58aa8586ceafad403 2023-02-09 17:54:20,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/da028f5171d34b11b8499edde42200e8 2023-02-09 17:54:20,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c5df17745da24bd79478c3426593bd0d 2023-02-09 17:54:20,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/c398c3abceed4a18956f3cd04bb8d7f5 2023-02-09 17:54:20,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/9d014877b3714c818531a0a33627aa05 2023-02-09 17:54:20,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/family1/1eac4d0ee29b4beb9e280ee3467e43aa_SeqId_44_ 2023-02-09 17:54:20,313 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:20,313 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:20,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 17:54:20,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing a046371abb5f5c08e5ab51af821baf0d, disabling compactions & flushes 2023-02-09 17:54:20,436 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. after waiting 0 ms 2023-02-09 17:54:20,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,437 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,437 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for a046371abb5f5c08e5ab51af821baf0d: Waiting for close lock at 1675965260436Disabling compacts and flushes for region at 1675965260436Disabling writes for close at 1675965260436Writing region close event to WAL at 1675965260437 (+1 ms)Closed at 1675965260437 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 6f576a3c5dfc02b76d6036c8a466e70a, disabling compactions & flushes 2023-02-09 17:54:20,443 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. after waiting 0 ms 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,443 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 6f576a3c5dfc02b76d6036c8a466e70a: Waiting for close lock at 1675965260443Disabling compacts and flushes for region at 1675965260443Disabling writes for close at 1675965260443Writing region close event to WAL at 1675965260443Closed at 1675965260443 2023-02-09 17:54:20,443 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,444 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 08df5076a8a74301ce9055f859f6894a, disabling compactions & flushes 2023-02-09 17:54:20,444 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,444 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,444 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. after waiting 0 ms 2023-02-09 17:54:20,444 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,444 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,444 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 08df5076a8a74301ce9055f859f6894a: Waiting for close lock at 1675965260444Disabling compacts and flushes for region at 1675965260444Disabling writes for close at 1675965260444Writing region close event to WAL at 1675965260444Closed at 1675965260444 2023-02-09 17:54:20,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:54:20,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965260447"}]},"ts":"1675965260447"} 2023-02-09 17:54:20,448 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965260447"}]},"ts":"1675965260447"} 2023-02-09 17:54:20,448 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675965260447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965260447"}]},"ts":"1675965260447"} 2023-02-09 17:54:20,451 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 17:54:20,452 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:54:20,452 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965260452"}]},"ts":"1675965260452"} 2023-02-09 17:54:20,454 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-09 17:54:20,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f576a3c5dfc02b76d6036c8a466e70a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=08df5076a8a74301ce9055f859f6894a, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a046371abb5f5c08e5ab51af821baf0d, ASSIGN}] 2023-02-09 17:54:20,459 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a046371abb5f5c08e5ab51af821baf0d, ASSIGN 2023-02-09 17:54:20,459 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f576a3c5dfc02b76d6036c8a466e70a, ASSIGN 2023-02-09 17:54:20,459 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=08df5076a8a74301ce9055f859f6894a, ASSIGN 2023-02-09 17:54:20,460 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=08df5076a8a74301ce9055f859f6894a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:20,460 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a046371abb5f5c08e5ab51af821baf0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:20,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f576a3c5dfc02b76d6036c8a466e70a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:20,612 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=08df5076a8a74301ce9055f859f6894a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,612 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6f576a3c5dfc02b76d6036c8a466e70a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,612 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=a046371abb5f5c08e5ab51af821baf0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,613 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965260612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965260612"}]},"ts":"1675965260612"} 2023-02-09 17:54:20,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675965260612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965260612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965260612"}]},"ts":"1675965260612"} 2023-02-09 17:54:20,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965260612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965260612"}]},"ts":"1675965260612"} 2023-02-09 17:54:20,614 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:20,614 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:20,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6f576a3c5dfc02b76d6036c8a466e70a, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:20,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 17:54:20,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 08df5076a8a74301ce9055f859f6894a, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:20,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure a046371abb5f5c08e5ab51af821baf0d, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:20,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6f576a3c5dfc02b76d6036c8a466e70a, NAME => 'testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 17:54:20,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,773 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,775 DEBUG [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/family1 2023-02-09 17:54:20,775 DEBUG [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/family1 2023-02-09 17:54:20,775 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f576a3c5dfc02b76d6036c8a466e70a columnFamilyName family1 2023-02-09 17:54:20,777 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] regionserver.HStore(310): Store=6f576a3c5dfc02b76d6036c8a466e70a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,777 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,778 DEBUG [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/family2 2023-02-09 17:54:20,778 DEBUG [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/family2 2023-02-09 17:54:20,779 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f576a3c5dfc02b76d6036c8a466e70a columnFamilyName family2 2023-02-09 17:54:20,780 INFO [StoreOpener-6f576a3c5dfc02b76d6036c8a466e70a-1] regionserver.HStore(310): Store=6f576a3c5dfc02b76d6036c8a466e70a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:54:20,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:54:20,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:20,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6f576a3c5dfc02b76d6036c8a466e70a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59733624, jitterRate=-0.10989964008331299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:54:20,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6f576a3c5dfc02b76d6036c8a466e70a: Running coprocessor pre-open hook at 1675965260772Writing region info on filesystem at 1675965260772Initializing all the Stores at 1675965260773 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260773Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260773Cleaning up temporary data from old regions at 1675965260782 (+9 ms)Cleaning up detritus from prior splits at 1675965260783 (+1 ms)Running coprocessor post-open hooks at 1675965260789 (+6 ms)Region opened successfully at 1675965260789 2023-02-09 17:54:20,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a., pid=31, masterSystemTime=1675965260768 2023-02-09 17:54:20,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:20,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a046371abb5f5c08e5ab51af821baf0d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 17:54:20,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,793 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6f576a3c5dfc02b76d6036c8a466e70a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,793 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965260792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965260792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965260792"}]},"ts":"1675965260792"} 2023-02-09 17:54:20,794 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,796 DEBUG [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1 2023-02-09 17:54:20,796 DEBUG [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1 2023-02-09 17:54:20,797 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a046371abb5f5c08e5ab51af821baf0d columnFamilyName family1 2023-02-09 17:54:20,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-09 17:54:20,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6f576a3c5dfc02b76d6036c8a466e70a, server=jenkins-hbase4.apache.org,42581,1675965218218 in 180 msec 2023-02-09 17:54:20,798 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] regionserver.HStore(310): Store=a046371abb5f5c08e5ab51af821baf0d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,798 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f576a3c5dfc02b76d6036c8a466e70a, ASSIGN in 340 msec 2023-02-09 17:54:20,804 DEBUG [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family2 2023-02-09 17:54:20,804 DEBUG [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family2 2023-02-09 17:54:20,805 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a046371abb5f5c08e5ab51af821baf0d columnFamilyName family2 2023-02-09 17:54:20,806 INFO [StoreOpener-a046371abb5f5c08e5ab51af821baf0d-1] regionserver.HStore(310): Store=a046371abb5f5c08e5ab51af821baf0d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:54:20,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:54:20,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:20,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a046371abb5f5c08e5ab51af821baf0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65980357, jitterRate=-0.016816064715385437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:54:20,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a046371abb5f5c08e5ab51af821baf0d: Running coprocessor pre-open hook at 1675965260793Writing region info on filesystem at 1675965260793Initializing all the Stores at 1675965260794 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260794Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260794Cleaning up temporary data from old regions at 1675965260809 (+15 ms)Cleaning up detritus from prior splits at 1675965260810 (+1 ms)Running coprocessor post-open hooks at 1675965260815 (+5 ms)Region opened successfully at 1675965260815 2023-02-09 17:54:20,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d., pid=33, masterSystemTime=1675965260768 2023-02-09 17:54:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:20,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08df5076a8a74301ce9055f859f6894a, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 17:54:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=a046371abb5f5c08e5ab51af821baf0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,819 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675965260818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965260818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965260818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965260818"}]},"ts":"1675965260818"} 2023-02-09 17:54:20,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-09 17:54:20,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure a046371abb5f5c08e5ab51af821baf0d, server=jenkins-hbase4.apache.org,42581,1675965218218 in 202 msec 2023-02-09 17:54:20,824 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=a046371abb5f5c08e5ab51af821baf0d, ASSIGN in 366 msec 2023-02-09 17:54:20,826 DEBUG [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/family1 2023-02-09 17:54:20,826 DEBUG [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/family1 2023-02-09 17:54:20,826 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08df5076a8a74301ce9055f859f6894a columnFamilyName family1 2023-02-09 17:54:20,827 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] regionserver.HStore(310): Store=08df5076a8a74301ce9055f859f6894a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,828 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,829 DEBUG [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/family2 2023-02-09 17:54:20,829 DEBUG [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/family2 2023-02-09 17:54:20,830 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08df5076a8a74301ce9055f859f6894a columnFamilyName family2 2023-02-09 17:54:20,831 INFO [StoreOpener-08df5076a8a74301ce9055f859f6894a-1] regionserver.HStore(310): Store=08df5076a8a74301ce9055f859f6894a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:20,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:54:20,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:54:20,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:20,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08df5076a8a74301ce9055f859f6894a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63180587, jitterRate=-0.05853588879108429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:54:20,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08df5076a8a74301ce9055f859f6894a: Running coprocessor pre-open hook at 1675965260819Writing region info on filesystem at 1675965260819Initializing all the Stores at 1675965260820 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260820Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965260822 (+2 ms)Cleaning up temporary data from old regions at 1675965260833 (+11 ms)Cleaning up detritus from prior splits at 1675965260833Running coprocessor post-open hooks at 1675965260837 (+4 ms)Region opened successfully at 1675965260837 2023-02-09 17:54:20,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a., pid=32, masterSystemTime=1675965260768 2023-02-09 17:54:20,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:20,840 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=08df5076a8a74301ce9055f859f6894a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:20,840 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675965260840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965260840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965260840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965260840"}]},"ts":"1675965260840"} 2023-02-09 17:54:20,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-02-09 17:54:20,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 08df5076a8a74301ce9055f859f6894a, server=jenkins-hbase4.apache.org,42581,1675965218218 in 225 msec 2023-02-09 17:54:20,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-09 17:54:20,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=08df5076a8a74301ce9055f859f6894a, ASSIGN in 389 msec 2023-02-09 17:54:20,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:54:20,850 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965260849"}]},"ts":"1675965260849"} 2023-02-09 17:54:20,851 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-09 17:54:20,855 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:54:20,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 848 msec 2023-02-09 17:54:21,116 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:21,116 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:21,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 17:54:21,117 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-09 17:54:21,123 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:21,124 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:21,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:21,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,126 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 17:54:21,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:21,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 17:54:21,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 17:54:21,127 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,127 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,129 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,129 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:21,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:21,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:21,129 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,129 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:21,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:21,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,130 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 17:54:21,130 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:21,130 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 17:54:21,130 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:21,130 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. started... 2023-02-09 17:54:21,130 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:21,130 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:54:21,131 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08df5076a8a74301ce9055f859f6894a: 2023-02-09 17:54:21,131 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:21,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:21,131 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. started... 2023-02-09 17:54:21,131 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. started... 2023-02-09 17:54:21,131 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:21,132 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6f576a3c5dfc02b76d6036c8a466e70a: 2023-02-09 17:54:21,132 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:54:21,132 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:21,132 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a046371abb5f5c08e5ab51af821baf0d 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-09 17:54:21,132 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:54:21,545 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097e85ae4a3a8c49dc90c3d412e3ddf480 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302097e85ae4a3a8c49dc90c3d412e3ddf480 2023-02-09 17:54:21,734 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-09 17:54:21,951 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp/family1/e469143ebf664fcdb6a1e19985ce717d 2023-02-09 17:54:21,956 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp/family1/e469143ebf664fcdb6a1e19985ce717d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d 2023-02-09 17:54:21,961 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 17:54:21,962 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for a046371abb5f5c08e5ab51af821baf0d in 830ms, sequenceid=5, compaction requested=false 2023-02-09 17:54:21,963 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a046371abb5f5c08e5ab51af821baf0d: 2023-02-09 17:54:21,963 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:54:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:54:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 17:54:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 17:54:21,965 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,965 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:21,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 17:54:21,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5905fecd[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:21,967 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 17:54:21,967 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,968 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 17:54:21,968 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 17:54:21,968 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:21,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:21,970 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 17:54:21,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:21,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 17:54:21,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:21,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 17:54:21,972 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 17:54:21,972 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:21,972 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:21,972 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,973 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:21,975 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,975 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:21,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,975 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:21,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:21,976 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,977 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,982 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,982 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:21,982 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:21,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-09 17:54:21,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 17:54:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:21,982 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:21,982 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:21,983 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:21,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:22,083 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:22,083 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:22,083 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:22,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:22,087 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:22,088 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:22,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:22,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:22,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,090 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 17:54:22,090 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:22,090 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 17:54:22,090 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 17:54:22,091 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,091 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,092 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,092 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:22,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:22,093 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,093 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,094 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-09 17:54:22,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 17:54:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:54:22,094 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. started... 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. started... 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. started... 2023-02-09 17:54:22,094 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08df5076a8a74301ce9055f859f6894a: 2023-02-09 17:54:22,095 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6f576a3c5dfc02b76d6036c8a466e70a: 2023-02-09 17:54:22,095 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:54:22,095 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:54:22,095 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:54:22,095 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:54:22,095 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a046371abb5f5c08e5ab51af821baf0d 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-09 17:54:22,517 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209555e10430b764236a77de0e6716a5b18 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209555e10430b764236a77de0e6716a5b18 2023-02-09 17:54:22,924 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp/family1/54cbe3a87a2c4478ad88a4b16cf8be35 2023-02-09 17:54:22,929 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp/family1/54cbe3a87a2c4478ad88a4b16cf8be35 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35 2023-02-09 17:54:22,933 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35, entries=2, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:22,934 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for a046371abb5f5c08e5ab51af821baf0d in 840ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:22,934 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a046371abb5f5c08e5ab51af821baf0d: 2023-02-09 17:54:22,934 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:22,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:54:22,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:54:22,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 17:54:22,934 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 17:54:22,937 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:22,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:22,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 17:54:22,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ab83c13[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:22,938 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 17:54:22,938 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,939 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,940 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 17:54:22,940 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 17:54:22,940 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:22,940 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,940 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:22,941 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,941 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 17:54:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:22,941 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:22,941 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 17:54:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:22,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 17:54:22,944 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 17:54:22,944 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:22,944 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:22,944 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,944 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:22,946 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,946 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,946 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:22,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:22,946 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,948 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:22,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:22,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:22,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 17:54:22,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,951 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:22,952 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:22,951 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:22,952 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:22,952 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:23,052 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:23,052 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:23,052 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:23,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:23,060 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-09 17:54:23,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 17:54:23,062 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 17:54:23,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:23,063 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965863063 2023-02-09 17:54:23,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:23,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-09 17:54:23,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 17:54:23,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x75931fb5 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:23,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@747c3c0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:23,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 17:54:23,909 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097768120b87de4e78967cc65cbc5df26d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302097768120b87de4e78967cc65cbc5df26d 2023-02-09 17:54:23,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 17:54:23,925 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:23,926 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:23,941 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:23,941 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:23,942 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:23,944 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:23,955 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/a54f420a3d0941ab95fbbefe01fc6234 first=Optional[k0] last=Optional[k1] 2023-02-09 17:54:23,956 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/a54f420a3d0941ab95fbbefe01fc6234}] 2023-02-09 17:54:23,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/a54f420a3d0941ab95fbbefe01fc6234 for inclusion in a046371abb5f5c08e5ab51af821baf0d/family1 2023-02-09 17:54:23,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-09 17:54:23,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 17:54:23,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for a046371abb5f5c08e5ab51af821baf0d: 2023-02-09 17:54:23,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/a54f420a3d0941ab95fbbefe01fc6234 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testScannerOnBulkLoadRefHFiles__9f26i6906tu587i6tig9rd35lrm2tg4ol7g23q6damuct2bevbmefaiubq4o2ldo/family1/a54f420a3d0941ab95fbbefe01fc6234 2023-02-09 17:54:23,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testScannerOnBulkLoadRefHFiles__9f26i6906tu587i6tig9rd35lrm2tg4ol7g23q6damuct2bevbmefaiubq4o2ldo/family1/a54f420a3d0941ab95fbbefe01fc6234 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_ 2023-02-09 17:54:23,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testScannerOnBulkLoadRefHFiles__9f26i6906tu587i6tig9rd35lrm2tg4ol7g23q6damuct2bevbmefaiubq4o2ldo/family1/a54f420a3d0941ab95fbbefe01fc6234 into a046371abb5f5c08e5ab51af821baf0d/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_ - updating store file list. 2023-02-09 17:54:23,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_ into a046371abb5f5c08e5ab51af821baf0d/family1 2023-02-09 17:54:23,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testScannerOnBulkLoadRefHFiles__9f26i6906tu587i6tig9rd35lrm2tg4ol7g23q6damuct2bevbmefaiubq4o2ldo/family1/a54f420a3d0941ab95fbbefe01fc6234 into a046371abb5f5c08e5ab51af821baf0d/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_) 2023-02-09 17:54:23,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testScannerOnBulkLoadRefHFiles__9f26i6906tu587i6tig9rd35lrm2tg4ol7g23q6damuct2bevbmefaiubq4o2ldo/family1/a54f420a3d0941ab95fbbefe01fc6234 2023-02-09 17:54:23,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:54:23,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:54:23,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): a046371abb5f5c08e5ab51af821baf0d/family1 is initiating minor compaction (all files) 2023-02-09 17:54:23,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7ce06b13; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:23,978 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a046371abb5f5c08e5ab51af821baf0d/family1 in testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:54:23,979 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp, totalSize=15.1 K 2023-02-09 17:54:23,980 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting e469143ebf664fcdb6a1e19985ce717d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965261118 2023-02-09 17:54:23,980 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 54cbe3a87a2c4478ad88a4b16cf8be35, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965261118 2023-02-09 17:54:23,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 17:54:23,981 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965261118 2023-02-09 17:54:23,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:23,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209555e10430b764236a77de0e6716a5b18 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209555e10430b764236a77de0e6716a5b18 2023-02-09 17:54:23,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302097e85ae4a3a8c49dc90c3d412e3ddf480 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302097e85ae4a3a8c49dc90c3d412e3ddf480 2023-02-09 17:54:23,984 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-09 17:54:23,984 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 17:54:23,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 17:54:23,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 17:54:23,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:23,986 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 17:54:23,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 925 msec 2023-02-09 17:54:23,997 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): a046371abb5f5c08e5ab51af821baf0d#family1#compaction#37 average throughput is 0.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:24,020 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=255 (was 258), OpenFileDescriptor=618 (was 620), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 280) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3294 (was 3296) 2023-02-09 17:54:24,033 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=168, AvailableMemoryMB=3294 2023-02-09 17:54:24,034 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:24,034 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:24,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:54:24,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:24,038 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:54:24,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-09 17:54:24,038 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:24,038 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:24,038 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:54:24,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:24,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:24,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067 empty. 2023-02-09 17:54:24,041 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:24,041 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-09 17:54:24,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:24,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:24,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:24,341 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:24,341 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:24,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:24,449 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:24,451 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 36456c17f39bbdd84b3e92271a1ce067, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:24,642 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:24,642 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:24,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:24,822 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/.tmp/family1/ffa67a1da70547a0889f003817c3d671 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/ffa67a1da70547a0889f003817c3d671 2023-02-09 17:54:24,827 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a046371abb5f5c08e5ab51af821baf0d/family1 of a046371abb5f5c08e5ab51af821baf0d into ffa67a1da70547a0889f003817c3d671(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:24,827 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a046371abb5f5c08e5ab51af821baf0d: 2023-02-09 17:54:24,827 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675965263978; duration=0sec 2023-02-09 17:54:24,827 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 36456c17f39bbdd84b3e92271a1ce067, disabling compactions & flushes 2023-02-09 17:54:24,858 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. after waiting 0 ms 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:24,858 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:24,858 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 36456c17f39bbdd84b3e92271a1ce067: Waiting for close lock at 1675965264858Disabling compacts and flushes for region at 1675965264858Disabling writes for close at 1675965264858Writing region close event to WAL at 1675965264858Closed at 1675965264858 2023-02-09 17:54:24,861 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:54:24,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965264861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965264861"}]},"ts":"1675965264861"} 2023-02-09 17:54:24,864 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:54:24,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_] to archive 2023-02-09 17:54:24,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:24,867 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:54:24,867 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965264867"}]},"ts":"1675965264867"} 2023-02-09 17:54:24,868 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 17:54:24,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/e469143ebf664fcdb6a1e19985ce717d 2023-02-09 17:54:24,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/54cbe3a87a2c4478ad88a4b16cf8be35 2023-02-09 17:54:24,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/family1/7b0eefbd5f18418fbf1ba2ed9ae76248_SeqId_12_ 2023-02-09 17:54:24,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=36456c17f39bbdd84b3e92271a1ce067, ASSIGN}] 2023-02-09 17:54:24,872 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=36456c17f39bbdd84b3e92271a1ce067, ASSIGN 2023-02-09 17:54:24,873 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=36456c17f39bbdd84b3e92271a1ce067, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:25,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=36456c17f39bbdd84b3e92271a1ce067, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:25,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965265024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965265024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965265024"}]},"ts":"1675965265024"} 2023-02-09 17:54:25,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 36456c17f39bbdd84b3e92271a1ce067, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:25,143 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:25,143 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:25,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:25,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:25,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36456c17f39bbdd84b3e92271a1ce067, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:25,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:25,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,182 INFO [StoreOpener-36456c17f39bbdd84b3e92271a1ce067-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,183 DEBUG [StoreOpener-36456c17f39bbdd84b3e92271a1ce067-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:25,183 DEBUG [StoreOpener-36456c17f39bbdd84b3e92271a1ce067-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:25,184 INFO [StoreOpener-36456c17f39bbdd84b3e92271a1ce067-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36456c17f39bbdd84b3e92271a1ce067 columnFamilyName family1 2023-02-09 17:54:25,185 INFO [StoreOpener-36456c17f39bbdd84b3e92271a1ce067-1] regionserver.HStore(310): Store=36456c17f39bbdd84b3e92271a1ce067/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:25,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:54:25,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:25,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 36456c17f39bbdd84b3e92271a1ce067; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68088307, jitterRate=0.01459483802318573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:25,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 36456c17f39bbdd84b3e92271a1ce067: Running coprocessor pre-open hook at 1675965265181Writing region info on filesystem at 1675965265181Initializing all the Stores at 1675965265181Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965265182 (+1 ms)Cleaning up temporary data from old regions at 1675965265187 (+5 ms)Cleaning up detritus from prior splits at 1675965265187Running coprocessor post-open hooks at 1675965265192 (+5 ms)Region opened successfully at 1675965265192 2023-02-09 17:54:25,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067., pid=37, masterSystemTime=1675965265177 2023-02-09 17:54:25,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:25,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:25,195 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=36456c17f39bbdd84b3e92271a1ce067, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:25,195 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675965265195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965265195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965265195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965265195"}]},"ts":"1675965265195"} 2023-02-09 17:54:25,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-09 17:54:25,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 36456c17f39bbdd84b3e92271a1ce067, server=jenkins-hbase4.apache.org,42581,1675965218218 in 171 msec 2023-02-09 17:54:25,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-09 17:54:25,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=36456c17f39bbdd84b3e92271a1ce067, ASSIGN in 327 msec 2023-02-09 17:54:25,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:54:25,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965265201"}]},"ts":"1675965265201"} 2023-02-09 17:54:25,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 17:54:25,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:54:25,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1700 sec 2023-02-09 17:54:26,145 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:26,145 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:26,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 17:54:26,146 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-09 17:54:26,166 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:26,166 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:26,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:26,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,169 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:26,169 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:26,169 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:26,169 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:26,169 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,169 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,171 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:26,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:26,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:26,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:26,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:26,172 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:26,172 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:26,173 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:54:26,274 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:54:26,593 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fc40feefc13348af903749c11dd1a0e1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc40feefc13348af903749c11dd1a0e1 2023-02-09 17:54:26,996 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/3afb654a30b84501b873d5bc2fb0d243 2023-02-09 17:54:27,002 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/3afb654a30b84501b873d5bc2fb0d243 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243 2023-02-09 17:54:27,007 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 17:54:27,008 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 835ms, sequenceid=5, compaction requested=false 2023-02-09 17:54:27,008 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:27,009 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:27,009 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:27,011 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,011 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:27,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38f1994c[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:27,013 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:27,013 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,014 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:27,014 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,015 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:27,017 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:27,019 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:27,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:27,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:27,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,019 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:27,020 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,020 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,020 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,021 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,022 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,024 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:27,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:27,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:27,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:27,024 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:27,125 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:27,125 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:27,125 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:27,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:27,129 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:27,129 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:27,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:27,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:27,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,131 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:27,131 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:27,131 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:27,132 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:27,132 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,132 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,133 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,133 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:27,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:27,134 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,134 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,134 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,135 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:27,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,135 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:27,135 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:27,135 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:27,135 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:27,135 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:27,135 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:27,135 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:27,135 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:54:27,548 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128588623275f61445887766176411446e8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128588623275f61445887766176411446e8 2023-02-09 17:54:27,953 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/032c24dbfd274c6388745dbcb0503fd6 2023-02-09 17:54:27,958 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/032c24dbfd274c6388745dbcb0503fd6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6 2023-02-09 17:54:27,962 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:27,963 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 828ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:27,964 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:27,964 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:27,967 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,967 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,967 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,967 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:27,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33cd8583[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:27,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:27,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,970 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:27,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:27,970 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,970 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:27,970 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:27,976 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:27,977 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,977 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:27,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:27,979 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:27,979 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:27,979 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:27,979 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,979 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:27,986 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,986 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:27,986 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:27,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:27,987 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:27,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:27,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:27,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:27,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:27,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:27,990 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:27,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,990 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:27,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:27,991 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:28,091 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:28,091 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:28,091 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:28,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:28,095 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:28,095 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:28,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:28,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:28,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,098 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:28,098 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:28,098 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:28,098 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:28,098 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,098 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,099 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:28,099 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:28,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:28,100 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,100 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:28,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:28,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:28,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:28,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:28,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:28,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:28,101 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:28,101 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:28,101 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:28,101 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:28,514 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016e0b08042eeb42288a9ec68d28fcad87 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016e0b08042eeb42288a9ec68d28fcad87 2023-02-09 17:54:28,919 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9 2023-02-09 17:54:28,924 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9 2023-02-09 17:54:28,929 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 17:54:28,930 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 829ms, sequenceid=13, compaction requested=true 2023-02-09 17:54:28,930 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:28,930 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:28,930 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:28,930 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:28,930 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,930 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:28,930 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:28,931 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,931 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:28,932 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,932 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:28,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:28,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4548f6a1[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:28,933 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:28,933 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,935 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:28,935 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,935 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:28,937 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:28,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:28,940 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:28,940 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:28,940 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:28,940 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,940 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:28,941 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,941 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:28,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,941 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:28,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:28,942 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,943 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,945 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:28,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:28,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:28,945 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,946 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:28,946 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:28,946 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:28,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:29,046 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:29,046 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:29,046 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:29,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:29,051 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:29,051 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:29,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:29,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:29,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,053 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:29,053 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:29,053 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:29,053 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:29,054 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,054 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,055 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:29,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:29,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:29,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:29,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,057 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:29,057 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:29,057 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:29,057 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:29,057 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:29,057 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:29,057 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:29,057 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:29,472 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055e077f10519649f480fb4f9f9b2cf4d0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055e077f10519649f480fb4f9f9b2cf4d0 2023-02-09 17:54:29,878 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/977b61403b2d4ec3909b28c9ddaf77bb 2023-02-09 17:54:29,883 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/977b61403b2d4ec3909b28c9ddaf77bb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb 2023-02-09 17:54:29,887 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 17:54:29,888 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 831ms, sequenceid=17, compaction requested=true 2023-02-09 17:54:29,888 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:29,888 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:29,891 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:29,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,891 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:29,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@edb12bf[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:29,893 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:29,893 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,894 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:29,894 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,894 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:29,895 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:29,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,896 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:29,896 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:29,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:29,898 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:29,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:29,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:29,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,898 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:29,899 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,899 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,899 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:29,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:29,900 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,901 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:29,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:29,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:29,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:29,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:29,904 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:29,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:29,905 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:29,905 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:30,005 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:30,005 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:30,005 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:30,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:30,009 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:30,010 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:30,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,012 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:30,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:30,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:30,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:30,013 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,013 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,014 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:30,014 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:30,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:30,015 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,015 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:30,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:30,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:30,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,016 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:30,016 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:30,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:30,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:30,017 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:30,017 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:30,017 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:30,017 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:30,434 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122825851163f2624a699e3afcde66fc1eb7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122825851163f2624a699e3afcde66fc1eb7 2023-02-09 17:54:30,840 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/a016854aff6b434ea3bd7929963da409 2023-02-09 17:54:30,845 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/a016854aff6b434ea3bd7929963da409 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409 2023-02-09 17:54:30,850 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 17:54:30,851 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 834ms, sequenceid=21, compaction requested=true 2023-02-09 17:54:30,851 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:30,851 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:30,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:30,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:30,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:30,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:30,856 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:30,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:30,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ad4d1d1[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:30,859 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:30,859 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,860 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:30,860 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:30,861 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:30,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:30,862 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:30,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:30,862 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:30,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:30,866 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:30,866 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:30,866 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:30,866 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,866 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:30,871 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,872 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:30,872 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:30,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,873 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,875 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:30,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:30,878 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:30,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:30,879 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,879 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:30,879 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,879 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:30,879 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:30,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:30,979 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:30,979 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:30,979 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:30,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:30,983 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:30,983 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:30,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:30,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:30,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,986 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:30,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:30,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:30,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:30,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,986 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,987 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:30,987 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:30,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:30,988 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:30,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:30,989 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:30,989 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:30,989 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:30,989 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:30,989 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:30,989 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:30,989 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:30,989 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:31,401 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123124bfb5bc0d1d4b88afdd7fd20b3c4524 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123124bfb5bc0d1d4b88afdd7fd20b3c4524 2023-02-09 17:54:31,806 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/985ee215e00145df99aabc5b342b4a5e 2023-02-09 17:54:31,812 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/985ee215e00145df99aabc5b342b4a5e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e 2023-02-09 17:54:31,817 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 17:54:31,817 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 828ms, sequenceid=25, compaction requested=true 2023-02-09 17:54:31,818 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:31,818 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:31,818 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:31,820 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,820 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:31,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:31,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:31,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65eaaa95[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:31,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:31,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,823 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:31,823 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:31,823 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:31,826 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,826 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:31,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:31,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:31,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:31,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:31,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:31,830 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:31,830 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:31,830 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:31,830 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,830 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:31,833 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,833 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,833 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:31,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,834 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,835 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:31,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,838 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:31,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:31,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:31,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:31,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,839 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:31,839 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:31,839 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,839 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,939 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:31,939 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:31,939 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:31,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:31,943 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:31,943 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:31,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:31,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:31,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,945 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:31,945 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:31,945 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:31,945 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:31,946 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,946 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,947 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,947 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:31,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:31,947 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:31,947 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,948 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,949 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:31,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:31,949 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:31,949 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:31,949 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:32,364 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101045565f532da4b14a10c4d9a921e80c4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101045565f532da4b14a10c4d9a921e80c4 2023-02-09 17:54:32,371 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/3779a583d8874b21a1777f5829cb0adf 2023-02-09 17:54:32,375 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/3779a583d8874b21a1777f5829cb0adf as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf 2023-02-09 17:54:32,379 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 17:54:32,380 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 431ms, sequenceid=29, compaction requested=true 2023-02-09 17:54:32,380 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:32,380 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:32,380 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:32,380 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:32,381 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,381 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:32,381 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:32,383 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,383 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:32,384 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,384 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:32,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:32,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6795b577[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:32,385 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:32,385 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,386 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:32,386 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,386 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:32,387 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,387 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:32,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:32,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:32,390 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:32,390 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:32,390 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:32,390 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,390 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:32,391 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,391 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:32,391 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:32,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,393 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,396 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,396 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:32,396 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:32,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:32,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:32,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:32,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:32,396 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,396 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:32,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,397 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,497 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:32,497 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:32,497 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:32,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:32,502 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:32,502 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:32,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:32,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:32,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,504 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:32,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:32,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:32,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:32,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,511 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,511 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:32,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:32,511 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:32,511 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,512 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,512 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:32,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:32,512 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:32,512 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:32,512 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:32,925 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f5da30eab91a43caa4403048fb9b644c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f5da30eab91a43caa4403048fb9b644c 2023-02-09 17:54:33,330 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/54dc19dd90624cb09cbf21250d69e8de 2023-02-09 17:54:33,335 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/54dc19dd90624cb09cbf21250d69e8de as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de 2023-02-09 17:54:33,340 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 17:54:33,341 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 829ms, sequenceid=33, compaction requested=true 2023-02-09 17:54:33,341 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:33,341 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:33,341 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:33,343 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:33,343 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:33,343 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,343 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:33,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:33,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310d1dd0[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:33,345 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:33,345 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,347 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,347 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:33,347 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:33,348 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,348 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:33,349 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,349 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:33,349 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:33,349 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:33,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:33,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:33,351 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:33,351 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:33,352 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:33,352 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,352 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:33,353 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,353 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:33,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:33,353 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:33,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,354 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:33,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:33,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:33,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:33,355 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:33,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:33,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,358 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:33,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:33,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:33,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:33,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:33,358 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:33,359 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:33,459 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:33,459 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:33,459 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:33,463 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:33,463 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:33,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,465 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:33,465 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:33,466 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:33,466 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:33,466 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,466 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,471 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,471 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:33,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:33,472 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:33,472 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,473 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:33,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:33,473 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:33,473 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:33,473 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:33,473 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:33,886 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073f2d888f0a8c450c89063b8f21f148d5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509073f2d888f0a8c450c89063b8f21f148d5 2023-02-09 17:54:34,291 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc 2023-02-09 17:54:34,296 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc 2023-02-09 17:54:34,300 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 17:54:34,301 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 827ms, sequenceid=37, compaction requested=true 2023-02-09 17:54:34,301 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:34,301 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:34,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,303 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:34,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:34,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:34,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dcb0879[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:34,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:34,304 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:34,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:34,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:34,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,306 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:34,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:34,307 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:34,307 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:34,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:34,309 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:34,309 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:34,309 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:34,309 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,309 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:34,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:34,312 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:34,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:34,312 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,313 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:34,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:34,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:34,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:34,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:34,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:34,315 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,315 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,316 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,416 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:34,416 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:34,416 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:34,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:34,420 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:34,420 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:34,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:34,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:34,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,423 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:34,423 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:34,423 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 17:54:34,423 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 17:54:34,423 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,423 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,424 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,424 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:34,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:34,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:34,424 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:34,425 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 17:54:34,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:34,426 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 17:54:34,426 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:34,426 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 17:54:34,426 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:34,426 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:34,426 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:34,426 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. started... 2023-02-09 17:54:34,426 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36456c17f39bbdd84b3e92271a1ce067 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:34,839 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c8f738b020264c67844cce316e87df66 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120c8f738b020264c67844cce316e87df66 2023-02-09 17:54:35,244 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/be19713d81914a44bdb1e2b4c8d5b832 2023-02-09 17:54:35,249 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/be19713d81914a44bdb1e2b4c8d5b832 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832 2023-02-09 17:54:35,253 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 17:54:35,254 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 36456c17f39bbdd84b3e92271a1ce067 in 828ms, sequenceid=41, compaction requested=true 2023-02-09 17:54:35,254 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:35,254 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:35,254 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 17:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 17:54:35,256 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,256 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:35,257 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,257 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:35,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 17:54:35,258 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 17:54:35,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc5b157[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:35,258 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,260 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,260 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 17:54:35,261 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 17:54:35,261 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:35,261 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,261 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:35,262 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 17:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 17:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:35,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:54:35,265 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 17:54:35,265 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:35,265 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:35,265 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,265 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:35,267 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,267 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:35,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,267 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:35,267 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,268 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,274 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:35,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 17:54:35,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:35,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 17:54:35,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:35,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:35,275 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:35,275 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:35,275 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,275 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:35,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:35,375 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:35,375 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:35,375 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:35,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:35,377 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-09 17:54:35,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:35,380 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:35,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:35,381 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965875381 2023-02-09 17:54:35,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:35,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 17:54:35,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:35,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x218cb321 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:35,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dbcba3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:35,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,231 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010372f53a86d69e4d7986591546fbce0682 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010372f53a86d69e4d7986591546fbce0682 2023-02-09 17:54:36,232 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:36,246 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:36,247 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:36,254 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:36,254 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:36,254 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:36,256 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57174, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:36,264 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e908d296d5bd4e2f8430f4d0886538fe first=Optional[r3] last=Optional[r6] 2023-02-09 17:54:36,264 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e908d296d5bd4e2f8430f4d0886538fe}] 2023-02-09 17:54:36,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e908d296d5bd4e2f8430f4d0886538fe for inclusion in 36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 17:54:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:36,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e908d296d5bd4e2f8430f4d0886538fe to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qbdfs3mk0qorc6smug8d2ag71it6eplqiq1jd4pbolojvc54ojggaqpda8tghpd1/family1/e908d296d5bd4e2f8430f4d0886538fe 2023-02-09 17:54:36,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qbdfs3mk0qorc6smug8d2ag71it6eplqiq1jd4pbolojvc54ojggaqpda8tghpd1/family1/e908d296d5bd4e2f8430f4d0886538fe as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_ 2023-02-09 17:54:36,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qbdfs3mk0qorc6smug8d2ag71it6eplqiq1jd4pbolojvc54ojggaqpda8tghpd1/family1/e908d296d5bd4e2f8430f4d0886538fe into 36456c17f39bbdd84b3e92271a1ce067/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_ - updating store file list. 2023-02-09 17:54:36,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_ into 36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:36,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qbdfs3mk0qorc6smug8d2ag71it6eplqiq1jd4pbolojvc54ojggaqpda8tghpd1/family1/e908d296d5bd4e2f8430f4d0886538fe into 36456c17f39bbdd84b3e92271a1ce067/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_) 2023-02-09 17:54:36,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qbdfs3mk0qorc6smug8d2ag71it6eplqiq1jd4pbolojvc54ojggaqpda8tghpd1/family1/e908d296d5bd4e2f8430f4d0886538fe 2023-02-09 17:54:36,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:54:36,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:54:36,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 36456c17f39bbdd84b3e92271a1ce067/family1 is initiating minor compaction 2023-02-09 17:54:36,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d147177; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:36,282 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 36456c17f39bbdd84b3e92271a1ce067/family1 in testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:36,282 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp, totalSize=50.0 K 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 032c24dbfd274c6388745dbcb0503fd6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting bd04d2436d0f4e4eaafe4383dcf5ebb9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 977b61403b2d4ec3909b28c9ddaf77bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a016854aff6b434ea3bd7929963da409, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 985ee215e00145df99aabc5b342b4a5e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3779a583d8874b21a1777f5829cb0adf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:54:36,282 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 54dc19dd90624cb09cbf21250d69e8de, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:54:36,283 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting cc0c0c8cea9c4fec98575b4f82b7dfbc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:54:36,283 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting be19713d81914a44bdb1e2b4c8d5b832, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:54:36,283 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:54:36,284 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:36,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:36,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122825851163f2624a699e3afcde66fc1eb7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122825851163f2624a699e3afcde66fc1eb7 2023-02-09 17:54:36,287 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123124bfb5bc0d1d4b88afdd7fd20b3c4524 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123124bfb5bc0d1d4b88afdd7fd20b3c4524 2023-02-09 17:54:36,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101045565f532da4b14a10c4d9a921e80c4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101045565f532da4b14a10c4d9a921e80c4 2023-02-09 17:54:36,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f5da30eab91a43caa4403048fb9b644c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f5da30eab91a43caa4403048fb9b644c 2023-02-09 17:54:36,290 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 17:54:36,290 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:36,317 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 36456c17f39bbdd84b3e92271a1ce067#family1#compaction#48 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:36,733 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/5ac46ef461f14dde9f29647979465fbd as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/5ac46ef461f14dde9f29647979465fbd 2023-02-09 17:54:36,738 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 36456c17f39bbdd84b3e92271a1ce067/family1 of 36456c17f39bbdd84b3e92271a1ce067 into 5ac46ef461f14dde9f29647979465fbd(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:36,738 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:36,738 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675965276282; duration=0sec 2023-02-09 17:54:36,738 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:36,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_] to archive 2023-02-09 17:54:36,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:36,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/032c24dbfd274c6388745dbcb0503fd6 2023-02-09 17:54:36,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/bd04d2436d0f4e4eaafe4383dcf5ebb9 2023-02-09 17:54:36,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/977b61403b2d4ec3909b28c9ddaf77bb 2023-02-09 17:54:36,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a016854aff6b434ea3bd7929963da409 2023-02-09 17:54:36,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/985ee215e00145df99aabc5b342b4a5e 2023-02-09 17:54:36,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3779a583d8874b21a1777f5829cb0adf 2023-02-09 17:54:36,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/54dc19dd90624cb09cbf21250d69e8de 2023-02-09 17:54:36,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/cc0c0c8cea9c4fec98575b4f82b7dfbc 2023-02-09 17:54:36,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/be19713d81914a44bdb1e2b4c8d5b832 2023-02-09 17:54:36,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/a5c93d16f90c4a2fb6e478a33b5090c9_SeqId_44_ 2023-02-09 17:54:37,152 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205578fb56bc05e4481b9a2ec61128f5ee8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205578fb56bc05e4481b9a2ec61128f5ee8 2023-02-09 17:54:37,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:37,171 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,171 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,179 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/985ff5c6d707460a8239ea98c8da23c1 first=Optional[r00] last=Optional[r2] 2023-02-09 17:54:37,179 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/985ff5c6d707460a8239ea98c8da23c1}] 2023-02-09 17:54:37,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/985ff5c6d707460a8239ea98c8da23c1 for inclusion in 36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:37,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 17:54:37,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:37,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/985ff5c6d707460a8239ea98c8da23c1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nas4d7ubaccl6l0k24hfe4ofvant5jp3gi3qbhn22pocgbf93nhtkd7obl71nht4/family1/985ff5c6d707460a8239ea98c8da23c1 2023-02-09 17:54:37,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nas4d7ubaccl6l0k24hfe4ofvant5jp3gi3qbhn22pocgbf93nhtkd7obl71nht4/family1/985ff5c6d707460a8239ea98c8da23c1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_ 2023-02-09 17:54:37,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nas4d7ubaccl6l0k24hfe4ofvant5jp3gi3qbhn22pocgbf93nhtkd7obl71nht4/family1/985ff5c6d707460a8239ea98c8da23c1 into 36456c17f39bbdd84b3e92271a1ce067/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_ - updating store file list. 2023-02-09 17:54:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_ into 36456c17f39bbdd84b3e92271a1ce067/family1 2023-02-09 17:54:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nas4d7ubaccl6l0k24hfe4ofvant5jp3gi3qbhn22pocgbf93nhtkd7obl71nht4/family1/985ff5c6d707460a8239ea98c8da23c1 into 36456c17f39bbdd84b3e92271a1ce067/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_) 2023-02-09 17:54:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyPolicy__nas4d7ubaccl6l0k24hfe4ofvant5jp3gi3qbhn22pocgbf93nhtkd7obl71nht4/family1/985ff5c6d707460a8239ea98c8da23c1 2023-02-09 17:54:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:54:37,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:54:37,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 36456c17f39bbdd84b3e92271a1ce067/family1 is initiating minor compaction (all files) 2023-02-09 17:54:37,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6033a293; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:37,196 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 36456c17f39bbdd84b3e92271a1ce067/family1 in testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:54:37,197 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/5ac46ef461f14dde9f29647979465fbd, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp, totalSize=337.0 K 2023-02-09 17:54:37,197 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3afb654a30b84501b873d5bc2fb0d243, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:54:37,197 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 5ac46ef461f14dde9f29647979465fbd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:54:37,198 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c1d7fef275cb4839b15082af01ecacfa_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842209 2023-02-09 17:54:37,198 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:37,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:37,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc40feefc13348af903749c11dd1a0e1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc40feefc13348af903749c11dd1a0e1 2023-02-09 17:54:37,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016e0b08042eeb42288a9ec68d28fcad87 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016e0b08042eeb42288a9ec68d28fcad87 2023-02-09 17:54:37,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055e077f10519649f480fb4f9f9b2cf4d0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055e077f10519649f480fb4f9f9b2cf4d0 2023-02-09 17:54:37,203 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-09 17:54:37,203 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 17:54:37,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 17:54:37,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 17:54:37,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:37,206 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:54:37,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8280 sec 2023-02-09 17:54:37,215 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 36456c17f39bbdd84b3e92271a1ce067#family1#compaction#49 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:37,314 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=262 (was 255) - Thread LEAK? -, OpenFileDescriptor=636 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 370), ProcessCount=168 (was 168), AvailableMemoryMB=3191 (was 3294) 2023-02-09 17:54:37,326 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=262, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=168, AvailableMemoryMB=3189 2023-02-09 17:54:37,326 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,327 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:54:37,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:37,330 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:54:37,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-09 17:54:37,331 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,331 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,331 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:54:37,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:37,333 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:37,333 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 empty. 2023-02-09 17:54:37,334 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:37,334 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-09 17:54:37,432 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,432 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:37,644 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,644 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:37,644 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,644 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75931fb5 to 127.0.0.1:59572 2023-02-09 17:54:37,644 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:37,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:37,647 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:37,648 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x218cb321 to 127.0.0.1:59572 2023-02-09 17:54:37,648 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:37,654 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:37,654 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ebaaac9 to 127.0.0.1:59572 2023-02-09 17:54:37,654 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:37,654 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:54:37,654 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e2ab712 to 127.0.0.1:59572 2023-02-09 17:54:37,654 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:54:37,743 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:37,744 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => a146aafefac4ec158955298f90ae2a23, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:37,947 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:37,948 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:37,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing a146aafefac4ec158955298f90ae2a23, disabling compactions & flushes 2023-02-09 17:54:38,150 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. after waiting 0 ms 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,150 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,150 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for a146aafefac4ec158955298f90ae2a23: Waiting for close lock at 1675965278150Disabling compacts and flushes for region at 1675965278150Disabling writes for close at 1675965278150Writing region close event to WAL at 1675965278150Closed at 1675965278150 2023-02-09 17:54:38,153 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:54:38,153 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965278153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965278153"}]},"ts":"1675965278153"} 2023-02-09 17:54:38,155 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:54:38,155 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:54:38,156 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965278156"}]},"ts":"1675965278156"} 2023-02-09 17:54:38,156 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-09 17:54:38,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, ASSIGN}] 2023-02-09 17:54:38,161 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, ASSIGN 2023-02-09 17:54:38,161 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:38,312 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:38,312 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965278312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965278312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965278312"}]},"ts":"1675965278312"} 2023-02-09 17:54:38,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:38,449 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:38,449 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:38,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:38,457 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/.tmp/family1/dee55bdb3e124dbb86a96d362731a321 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/dee55bdb3e124dbb86a96d362731a321 2023-02-09 17:54:38,461 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 36456c17f39bbdd84b3e92271a1ce067/family1 of 36456c17f39bbdd84b3e92271a1ce067 into dee55bdb3e124dbb86a96d362731a321(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:54:38,461 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 36456c17f39bbdd84b3e92271a1ce067: 2023-02-09 17:54:38,461 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675965277196; duration=1sec 2023-02-09 17:54:38,462 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:38,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/5ac46ef461f14dde9f29647979465fbd, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_] to archive 2023-02-09 17:54:38,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:38,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a146aafefac4ec158955298f90ae2a23, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:38,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/3afb654a30b84501b873d5bc2fb0d243 2023-02-09 17:54:38,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:38,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,470 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/5ac46ef461f14dde9f29647979465fbd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/5ac46ef461f14dde9f29647979465fbd 2023-02-09 17:54:38,471 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:38,472 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:38,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/family1/c1d7fef275cb4839b15082af01ecacfa_SeqId_47_ 2023-02-09 17:54:38,472 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a146aafefac4ec158955298f90ae2a23 columnFamilyName family1 2023-02-09 17:54:38,473 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(310): Store=a146aafefac4ec158955298f90ae2a23/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:38,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:38,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a146aafefac4ec158955298f90ae2a23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67890945, jitterRate=0.011653915047645569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:38,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a146aafefac4ec158955298f90ae2a23: Running coprocessor pre-open hook at 1675965278469Writing region info on filesystem at 1675965278469Initializing all the Stores at 1675965278470 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965278470Cleaning up temporary data from old regions at 1675965278475 (+5 ms)Cleaning up detritus from prior splits at 1675965278475Running coprocessor post-open hooks at 1675965278479 (+4 ms)Region opened successfully at 1675965278479 2023-02-09 17:54:38,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., pid=41, masterSystemTime=1675965278466 2023-02-09 17:54:38,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:38,482 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:38,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965278482"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965278482"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965278482"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965278482"}]},"ts":"1675965278482"} 2023-02-09 17:54:38,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-09 17:54:38,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218 in 169 msec 2023-02-09 17:54:38,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-09 17:54:38,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, ASSIGN in 325 msec 2023-02-09 17:54:38,486 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:54:38,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965278486"}]},"ts":"1675965278486"} 2023-02-09 17:54:38,487 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-09 17:54:38,491 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:54:38,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-02-09 17:54:39,450 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:39,450 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:39,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 17:54:39,451 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-09 17:54:39,470 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:39,470 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:39,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:39,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,472 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:39,472 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:39,472 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:39,473 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:39,473 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,473 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,476 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:39,476 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:39,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:39,476 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,476 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:39,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,477 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:39,477 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:39,479 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:39,479 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:39,479 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:39,479 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:39,480 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:54:39,736 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:39,787 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 17:54:39,898 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113075a293a7559a4803bd25248615c9c78b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113075a293a7559a4803bd25248615c9c78b 2023-02-09 17:54:40,302 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/eabe04552f60463e9c57259cc6afe415 2023-02-09 17:54:40,307 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/eabe04552f60463e9c57259cc6afe415 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415 2023-02-09 17:54:40,311 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-09 17:54:40,312 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 833ms, sequenceid=5, compaction requested=false 2023-02-09 17:54:40,312 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:40,312 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:40,314 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,314 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:40,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:40,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57319195[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:40,316 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:40,316 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,317 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:40,317 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,318 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:40,320 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,320 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:40,320 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,320 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:40,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:40,322 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:40,322 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:40,322 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:40,322 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,322 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:40,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,324 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:40,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:40,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:40,324 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,325 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,327 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:40,327 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:40,328 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:40,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:40,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:40,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:40,328 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,428 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:40,429 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:40,429 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:40,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:40,433 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:40,433 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:40,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:40,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:40,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,435 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:40,435 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:40,435 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:40,435 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:40,435 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,435 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,436 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:40,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:40,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:40,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:40,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:40,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:40,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:40,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:40,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:40,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:40,438 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:40,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:40,438 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:40,438 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:54:40,850 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a268b24250e348d7a425cdda114b2b82 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a268b24250e348d7a425cdda114b2b82 2023-02-09 17:54:41,255 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/1f6def8bed1e42619602541982dfc2f9 2023-02-09 17:54:41,261 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/1f6def8bed1e42619602541982dfc2f9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9 2023-02-09 17:54:41,265 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:41,266 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 828ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:41,266 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:41,266 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:41,266 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:41,268 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:41,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:41,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:41,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:41,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0be53e[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:41,270 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:41,270 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,271 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:41,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:41,271 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:41,272 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,272 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:41,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:41,273 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:41,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:41,275 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:41,275 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:41,275 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:41,275 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,275 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:41,278 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,278 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:41,278 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,278 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:41,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,279 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,285 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:41,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:41,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:41,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:41,285 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:41,385 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:41,386 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:41,386 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:41,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:41,389 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:41,390 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:41,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:41,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:41,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,392 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:41,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:41,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:41,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:41,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,392 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,394 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:41,394 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:41,394 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:41,394 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:41,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:41,395 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:41,395 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:41,395 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:41,395 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:41,809 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120101e3998e9c1846ceae803668401dba4c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e3998e9c1846ceae803668401dba4c 2023-02-09 17:54:42,215 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/1b7b8902fa354399bb996389c0df1fa6 2023-02-09 17:54:42,220 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/1b7b8902fa354399bb996389c0df1fa6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6 2023-02-09 17:54:42,223 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 17:54:42,224 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 829ms, sequenceid=13, compaction requested=true 2023-02-09 17:54:42,224 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:42,224 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:42,227 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:42,227 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:42,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:42,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bf6bc46[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:42,229 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:42,229 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,230 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,230 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:42,230 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,230 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:42,230 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:42,230 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:42,231 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:42,232 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:42,232 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:42,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:42,234 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:42,234 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:42,234 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:42,234 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,234 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:42,235 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,235 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:42,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,235 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:42,236 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,237 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:42,240 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:42,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:42,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:42,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:42,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:42,240 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,341 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:42,341 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:42,341 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:42,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:42,345 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:42,345 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:42,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:42,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:42,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,347 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:42,347 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:42,347 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:42,347 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:42,348 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,348 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,349 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,349 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:42,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:42,349 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:42,349 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:42,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:42,350 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:42,350 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:42,350 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:42,766 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205daa5fcbe0de74f0eb70138b168e77241 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205daa5fcbe0de74f0eb70138b168e77241 2023-02-09 17:54:43,171 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/b8dc5f634d92417f91504a13763c7e4a 2023-02-09 17:54:43,175 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/b8dc5f634d92417f91504a13763c7e4a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a 2023-02-09 17:54:43,179 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 17:54:43,180 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 830ms, sequenceid=17, compaction requested=true 2023-02-09 17:54:43,180 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:43,180 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,182 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:43,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:43,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:43,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b09e566[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:43,183 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:43,183 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,185 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,185 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:43,185 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:43,185 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:43,185 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,185 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:43,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:43,188 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:43,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:43,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:43,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:43,191 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:43,191 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:43,191 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:43,191 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,191 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:43,192 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:43,193 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:43,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:43,193 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,194 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:43,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:43,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:43,196 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,196 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:43,197 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:43,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:43,297 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:43,297 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:43,297 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:43,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:43,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:43,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:43,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:43,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:43,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,303 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:43,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:43,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:43,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:43,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,303 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,305 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,305 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:43,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:43,305 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:43,305 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,306 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,306 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:43,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:43,306 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:43,306 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:43,306 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:43,718 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b9294b5764124212b78345020e1130eb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b9294b5764124212b78345020e1130eb 2023-02-09 17:54:43,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:54:44,123 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/101e5200d65f4d7bbef70b88fc380aff 2023-02-09 17:54:44,129 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/101e5200d65f4d7bbef70b88fc380aff as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff 2023-02-09 17:54:44,133 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 17:54:44,133 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 827ms, sequenceid=21, compaction requested=true 2023-02-09 17:54:44,134 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:44,134 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:44,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:44,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:44,141 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:44,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@106f68ab[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:44,141 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,142 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:44,143 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,143 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:44,144 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,144 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:44,144 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,144 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:44,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:44,146 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:44,146 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:44,146 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:44,146 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,146 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:44,148 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,148 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,148 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:44,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:44,149 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:44,150 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,152 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,152 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:44,152 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:44,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:44,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:44,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:44,152 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:44,152 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,152 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:44,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:44,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,153 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:44,253 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:44,253 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:44,253 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:44,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:44,257 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:44,257 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:44,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:44,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:44,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,259 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:44,259 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:44,259 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:44,259 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:44,260 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,260 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,261 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,261 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:44,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:44,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:44,262 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:44,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:44,263 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:44,263 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:44,263 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:44,263 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:44,675 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313e3b60fdc61941c496dba671f9d0e9cd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313e3b60fdc61941c496dba671f9d0e9cd 2023-02-09 17:54:45,081 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/435498cf5f5b43ca9e731ef44fe3f200 2023-02-09 17:54:45,086 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/435498cf5f5b43ca9e731ef44fe3f200 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200 2023-02-09 17:54:45,090 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 17:54:45,090 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 827ms, sequenceid=25, compaction requested=true 2023-02-09 17:54:45,091 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:45,091 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,092 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:45,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:45,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@419c4d8d[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:45,094 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:45,094 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,097 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:45,097 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,097 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:45,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:45,098 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:45,098 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:45,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:45,100 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:45,100 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:45,100 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:45,100 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,100 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:45,102 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,102 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,102 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:45,103 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,104 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:45,106 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:45,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:45,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:45,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,106 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:45,107 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:45,107 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:45,207 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:45,207 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:45,207 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:45,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:45,211 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:45,211 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:45,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:45,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:45,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,214 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:45,214 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:45,214 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:45,214 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:45,214 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,214 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,216 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,216 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:45,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:45,216 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:45,216 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,217 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:45,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:45,217 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:45,217 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:45,218 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:45,218 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:45,218 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:45,218 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:45,218 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:45,218 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:45,629 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019fc9cdf1c02a4d938dce4b2a49017547 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019fc9cdf1c02a4d938dce4b2a49017547 2023-02-09 17:54:46,035 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/25f770a918644121a26306c90f8a6686 2023-02-09 17:54:46,039 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/25f770a918644121a26306c90f8a6686 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686 2023-02-09 17:54:46,044 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 17:54:46,044 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 826ms, sequenceid=29, compaction requested=true 2023-02-09 17:54:46,044 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:46,045 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:46,046 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:46,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:46,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fc6dd74[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:46,048 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:46,048 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,050 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:46,050 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:46,050 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:46,051 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:46,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:46,053 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:46,054 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:46,054 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:46,054 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,054 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:46,059 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,059 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,059 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:46,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:46,059 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,060 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,063 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,063 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:46,063 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:46,063 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:46,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:46,064 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:46,063 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,064 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,164 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:46,164 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:46,164 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:46,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:46,169 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:46,169 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:46,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:46,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:46,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,171 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:46,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:46,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:46,171 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:46,172 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,172 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,173 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:46,173 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:46,174 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:46,174 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,174 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,175 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:46,175 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:46,175 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:46,175 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:46,588 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031cd0318f3a3a4add81aaa465e8364778 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031cd0318f3a3a4add81aaa465e8364778 2023-02-09 17:54:46,993 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/ec77c2e53c9b42a5a7b2ced269582a1b 2023-02-09 17:54:46,998 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/ec77c2e53c9b42a5a7b2ced269582a1b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b 2023-02-09 17:54:47,002 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 17:54:47,003 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 828ms, sequenceid=33, compaction requested=true 2023-02-09 17:54:47,003 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:47,003 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:47,003 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:47,006 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,006 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,006 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,006 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:47,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:47,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@be02b3f[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:47,007 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:47,007 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,008 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:47,008 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,008 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:47,010 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:47,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:47,012 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:47,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:47,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:47,012 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,012 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:47,014 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,014 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,014 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:47,014 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,015 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:47,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:47,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:47,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:47,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:47,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:47,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,019 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:47,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:47,019 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,019 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:47,019 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,119 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:47,119 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:47,119 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:47,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:47,123 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:47,123 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:47,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:47,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:47,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,126 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:47,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:47,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:47,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:47,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,127 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:47,127 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:47,128 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,128 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,128 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:47,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:47,129 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:47,129 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:47,129 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:47,542 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090751c99590f99f4de08a22666999a48d43 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090751c99590f99f4de08a22666999a48d43 2023-02-09 17:54:47,947 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/a6f2497e3b0140a49c9025f593c01861 2023-02-09 17:54:47,951 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/a6f2497e3b0140a49c9025f593c01861 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861 2023-02-09 17:54:47,955 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 17:54:47,956 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 827ms, sequenceid=37, compaction requested=true 2023-02-09 17:54:47,956 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:47,956 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:47,958 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:47,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@602130d8[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:47,959 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:47,959 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,960 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:47,961 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,961 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:47,963 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:47,963 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:47,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:47,965 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:47,965 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:47,965 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:47,965 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,965 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:47,967 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,967 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:47,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,967 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:47,967 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:47,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,972 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:47,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:47,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:47,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:47,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:47,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 17:54:47,972 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:47,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:47,973 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:48,073 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:48,073 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:48,074 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:48,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:48,078 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:48,078 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:48,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:48,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:48,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,080 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:48,080 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:48,080 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 17:54:48,080 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 17:54:48,081 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,081 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,082 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:48,082 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:48,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:48,082 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,082 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:48,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:48,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 17:54:48,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 17:54:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 17:54:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:48,083 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:48,083 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:48,084 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. started... 2023-02-09 17:54:48,084 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a146aafefac4ec158955298f90ae2a23 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:48,495 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112077448a3387bf4a0b96942b8867acbc32 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112077448a3387bf4a0b96942b8867acbc32 2023-02-09 17:54:48,900 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/81f27ec9e82b4ceb81415a0b30e424bc 2023-02-09 17:54:48,904 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/81f27ec9e82b4ceb81415a0b30e424bc as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc 2023-02-09 17:54:48,908 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 17:54:48,909 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a146aafefac4ec158955298f90ae2a23 in 825ms, sequenceid=41, compaction requested=true 2023-02-09 17:54:48,909 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:48,909 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 17:54:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 17:54:48,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,911 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:48,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:48,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 17:54:48,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4372f974[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:48,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 17:54:48,913 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:48,919 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,919 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:48,920 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 17:54:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 17:54:48,922 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 17:54:48,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:48,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:48,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,922 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:48,924 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:48,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:48,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:48,924 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,925 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,927 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,928 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:48,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:48,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:48,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:48,928 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:49,028 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:49,028 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:49,029 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:49,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:49,031 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:49,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:49,033 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:49,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:49,034 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965889034 2023-02-09 17:54:49,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:49,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 17:54:49,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:49,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x69b6f5b9 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:49,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e496c07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:49,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,483 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103febd4372612e4f0dbd3935b5d5bad8c3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103febd4372612e4f0dbd3935b5d5bad8c3 2023-02-09 17:54:49,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:49,496 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:49,498 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57486, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:49,503 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:49,503 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:49,503 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:49,505 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:49,513 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44232d971a4b468494ce110fc664e172 first=Optional[r3] last=Optional[r6] 2023-02-09 17:54:49,513 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44232d971a4b468494ce110fc664e172}] 2023-02-09 17:54:49,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44232d971a4b468494ce110fc664e172 for inclusion in a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:49,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 17:54:49,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:49,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:49,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/44232d971a4b468494ce110fc664e172 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vioqb7t5qbsv8ob34niucccddv7blr0k26eqks53ub886pbsg9o1usbkv03tiscm/family1/44232d971a4b468494ce110fc664e172 2023-02-09 17:54:49,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vioqb7t5qbsv8ob34niucccddv7blr0k26eqks53ub886pbsg9o1usbkv03tiscm/family1/44232d971a4b468494ce110fc664e172 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_ 2023-02-09 17:54:49,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vioqb7t5qbsv8ob34niucccddv7blr0k26eqks53ub886pbsg9o1usbkv03tiscm/family1/44232d971a4b468494ce110fc664e172 into a146aafefac4ec158955298f90ae2a23/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_ - updating store file list. 2023-02-09 17:54:49,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_ into a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:49,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vioqb7t5qbsv8ob34niucccddv7blr0k26eqks53ub886pbsg9o1usbkv03tiscm/family1/44232d971a4b468494ce110fc664e172 into a146aafefac4ec158955298f90ae2a23/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_) 2023-02-09 17:54:49,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vioqb7t5qbsv8ob34niucccddv7blr0k26eqks53ub886pbsg9o1usbkv03tiscm/family1/44232d971a4b468494ce110fc664e172 2023-02-09 17:54:49,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:54:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:54:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): a146aafefac4ec158955298f90ae2a23/family1 is initiating minor compaction 2023-02-09 17:54:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bd1339c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:49,529 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a146aafefac4ec158955298f90ae2a23/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:49,529 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp, totalSize=50.4 K 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 1f6def8bed1e42619602541982dfc2f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 1b7b8902fa354399bb996389c0df1fa6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting b8dc5f634d92417f91504a13763c7e4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 101e5200d65f4d7bbef70b88fc380aff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 435498cf5f5b43ca9e731ef44fe3f200, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 25f770a918644121a26306c90f8a6686, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting ec77c2e53c9b42a5a7b2ced269582a1b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a6f2497e3b0140a49c9025f593c01861, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 81f27ec9e82b4ceb81415a0b30e424bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:54:49,529 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3f10c5bbd47a448ab7e2e32808398889_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:54:49,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:49,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:49,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b9294b5764124212b78345020e1130eb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b9294b5764124212b78345020e1130eb 2023-02-09 17:54:49,534 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313e3b60fdc61941c496dba671f9d0e9cd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313e3b60fdc61941c496dba671f9d0e9cd 2023-02-09 17:54:49,535 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019fc9cdf1c02a4d938dce4b2a49017547 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019fc9cdf1c02a4d938dce4b2a49017547 2023-02-09 17:54:49,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031cd0318f3a3a4add81aaa465e8364778 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031cd0318f3a3a4add81aaa465e8364778 2023-02-09 17:54:49,536 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-09 17:54:49,536 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 17:54:49,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:49,555 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): a146aafefac4ec158955298f90ae2a23#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:50,373 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/eec3ef3023244254bb3652e46b2b38ed as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eec3ef3023244254bb3652e46b2b38ed 2023-02-09 17:54:50,378 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a146aafefac4ec158955298f90ae2a23/family1 of a146aafefac4ec158955298f90ae2a23 into eec3ef3023244254bb3652e46b2b38ed(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:54:50,378 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:50,379 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675965289529; duration=0sec 2023-02-09 17:54:50,379 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ec7a5adb7da54a3f9eff09fc03f89db9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec7a5adb7da54a3f9eff09fc03f89db9 2023-02-09 17:54:50,379 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:50,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:50,397 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:50,398 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:50,405 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6c4109a052a64c039d30acd82f9bf569 first=Optional[r00] last=Optional[r2] 2023-02-09 17:54:50,405 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6c4109a052a64c039d30acd82f9bf569}] 2023-02-09 17:54:50,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6c4109a052a64c039d30acd82f9bf569 for inclusion in a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 17:54:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:50,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6c4109a052a64c039d30acd82f9bf569 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fplecgca9j0romjees13ogtd07djp7n45ote8nqh3bu98lcimf7vl9uvd41qo70s/family1/6c4109a052a64c039d30acd82f9bf569 2023-02-09 17:54:50,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fplecgca9j0romjees13ogtd07djp7n45ote8nqh3bu98lcimf7vl9uvd41qo70s/family1/6c4109a052a64c039d30acd82f9bf569 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_ 2023-02-09 17:54:50,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fplecgca9j0romjees13ogtd07djp7n45ote8nqh3bu98lcimf7vl9uvd41qo70s/family1/6c4109a052a64c039d30acd82f9bf569 into a146aafefac4ec158955298f90ae2a23/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_ - updating store file list. 2023-02-09 17:54:50,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_ into a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:50,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fplecgca9j0romjees13ogtd07djp7n45ote8nqh3bu98lcimf7vl9uvd41qo70s/family1/6c4109a052a64c039d30acd82f9bf569 into a146aafefac4ec158955298f90ae2a23/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_) 2023-02-09 17:54:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fplecgca9j0romjees13ogtd07djp7n45ote8nqh3bu98lcimf7vl9uvd41qo70s/family1/6c4109a052a64c039d30acd82f9bf569 2023-02-09 17:54:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:54:50,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:54:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): a146aafefac4ec158955298f90ae2a23/family1 is initiating minor compaction (all files) 2023-02-09 17:54:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3b3cad1b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:50,418 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a146aafefac4ec158955298f90ae2a23/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:50,418 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eec3ef3023244254bb3652e46b2b38ed, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp, totalSize=390.1 K 2023-02-09 17:54:50,418 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting eabe04552f60463e9c57259cc6afe415, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:54:50,419 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting eec3ef3023244254bb3652e46b2b38ed, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:54:50,419 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting f9fc3f083e44420093a13e7f0adf7335_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842209 2023-02-09 17:54:50,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:50,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:50,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113075a293a7559a4803bd25248615c9c78b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113075a293a7559a4803bd25248615c9c78b 2023-02-09 17:54:50,423 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e3998e9c1846ceae803668401dba4c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e3998e9c1846ceae803668401dba4c 2023-02-09 17:54:50,424 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205daa5fcbe0de74f0eb70138b168e77241 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205daa5fcbe0de74f0eb70138b168e77241 2023-02-09 17:54:50,424 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-09 17:54:50,424 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 17:54:50,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:50,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:50,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:50,426 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:50,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.3950 sec 2023-02-09 17:54:50,436 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): a146aafefac4ec158955298f90ae2a23#family1#compaction#61 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:54:50,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_] to archive 2023-02-09 17:54:50,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:50,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1f6def8bed1e42619602541982dfc2f9 2023-02-09 17:54:50,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/1b7b8902fa354399bb996389c0df1fa6 2023-02-09 17:54:50,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/b8dc5f634d92417f91504a13763c7e4a 2023-02-09 17:54:50,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/101e5200d65f4d7bbef70b88fc380aff 2023-02-09 17:54:50,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/435498cf5f5b43ca9e731ef44fe3f200 2023-02-09 17:54:50,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/25f770a918644121a26306c90f8a6686 2023-02-09 17:54:50,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/ec77c2e53c9b42a5a7b2ced269582a1b 2023-02-09 17:54:50,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/a6f2497e3b0140a49c9025f593c01861 2023-02-09 17:54:50,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/81f27ec9e82b4ceb81415a0b30e424bc 2023-02-09 17:54:50,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3f10c5bbd47a448ab7e2e32808398889_SeqId_44_ 2023-02-09 17:54:50,500 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:50,500 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:50,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 17:54:50,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:50,912 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 17:54:50,913 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:50,913 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 17:54:50,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 17:54:50,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE}] 2023-02-09 17:54:50,918 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE 2023-02-09 17:54:50,918 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:50,918 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965290918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965290918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965290918"}]},"ts":"1675965290918"} 2023-02-09 17:54:50,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:51,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a146aafefac4ec158955298f90ae2a23, disabling compactions & flushes 2023-02-09 17:54:51,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,652 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/.tmp/family1/755da3de3950416590f5026c65bb06ef as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/755da3de3950416590f5026c65bb06ef 2023-02-09 17:54:51,656 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a146aafefac4ec158955298f90ae2a23/family1 of a146aafefac4ec158955298f90ae2a23 into 755da3de3950416590f5026c65bb06ef(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:54:51,657 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:51,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,657 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675965290418; duration=1sec 2023-02-09 17:54:51,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. after waiting 0 ms 2023-02-09 17:54:51,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,657 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:54:51,657 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eec3ef3023244254bb3652e46b2b38ed, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_] to archive 2023-02-09 17:54:51,658 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:51,659 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eabe04552f60463e9c57259cc6afe415 2023-02-09 17:54:51,660 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eec3ef3023244254bb3652e46b2b38ed to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/eec3ef3023244254bb3652e46b2b38ed 2023-02-09 17:54:51,661 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/f9fc3f083e44420093a13e7f0adf7335_SeqId_47_ 2023-02-09 17:54:51,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 17:54:51,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a146aafefac4ec158955298f90ae2a23: Waiting for close lock at 1675965291071Running coprocessor pre-close hooks at 1675965291071Disabling compacts and flushes for region at 1675965291071Disabling writes for close at 1675965291657 (+586 ms)Writing region close event to WAL at 1675965291663 (+6 ms)Running coprocessor post-close hooks at 1675965291667 (+4 ms)Closed at 1675965291667 2023-02-09 17:54:51,667 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: a146aafefac4ec158955298f90ae2a23 to self. 2023-02-09 17:54:51,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=CLOSED 2023-02-09 17:54:51,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965291669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965291669"}]},"ts":"1675965291669"} 2023-02-09 17:54:51,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-09 17:54:51,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218 in 751 msec 2023-02-09 17:54:51,671 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=true 2023-02-09 17:54:51,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:51,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965291822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965291822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965291822"}]},"ts":"1675965291822"} 2023-02-09 17:54:51,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:51,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a146aafefac4ec158955298f90ae2a23, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:51,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:51,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,979 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,980 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:51,980 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:51,981 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a146aafefac4ec158955298f90ae2a23 columnFamilyName family1 2023-02-09 17:54:51,985 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/755da3de3950416590f5026c65bb06ef 2023-02-09 17:54:51,985 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(310): Store=a146aafefac4ec158955298f90ae2a23/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:51,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:51,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a146aafefac4ec158955298f90ae2a23; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69280530, jitterRate=0.032360345125198364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:51,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a146aafefac4ec158955298f90ae2a23: Running coprocessor pre-open hook at 1675965291978Writing region info on filesystem at 1675965291978Initializing all the Stores at 1675965291979 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675965291979Cleaning up temporary data from old regions at 1675965291987 (+8 ms)Cleaning up detritus from prior splits at 1675965291987Running coprocessor post-open hooks at 1675965291990 (+3 ms)Region opened successfully at 1675965291990 2023-02-09 17:54:51,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., pid=47, masterSystemTime=1675965291975 2023-02-09 17:54:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:51,992 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:51,992 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965291992"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965291992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965291992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965291992"}]},"ts":"1675965291992"} 2023-02-09 17:54:51,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-09 17:54:51,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218 in 169 msec 2023-02-09 17:54:51,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-09 17:54:51,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE in 1.0780 sec 2023-02-09 17:54:51,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-09 17:54:51,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0810 sec 2023-02-09 17:54:51,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4970 sec 2023-02-09 17:54:52,000 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,000 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:52,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-09 17:54:52,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:52,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,001 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:52,002 INFO [Listener at localhost/44673] compactions.TestMobCompactor(278): alter status finished 2023-02-09 17:54:52,003 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:52,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:52,005 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:52,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:52,005 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965892005 2023-02-09 17:54:52,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:52,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 17:54:52,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:52,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x6996c339 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:52,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c8aa358, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,838 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ddda24a7b4534eb985a5ed354bdc56be to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ddda24a7b4534eb985a5ed354bdc56be 2023-02-09 17:54:52,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:52,851 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:54:52,852 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:54:52,857 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,857 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,858 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:54:52,859 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:54:52,867 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f97a824041774c5885e858ec64ab9195 first=Optional[r05] last=Optional[r8] 2023-02-09 17:54:52,867 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f97a824041774c5885e858ec64ab9195}] 2023-02-09 17:54:52,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f97a824041774c5885e858ec64ab9195 for inclusion in a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 17:54:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:54:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for a146aafefac4ec158955298f90ae2a23: 2023-02-09 17:54:52,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f97a824041774c5885e858ec64ab9195 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5dtro4vr6keqp06d961sl40o1ot16au7n5edu235om6vbqorjusqt32bo2ksreg/family1/f97a824041774c5885e858ec64ab9195 2023-02-09 17:54:52,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5dtro4vr6keqp06d961sl40o1ot16au7n5edu235om6vbqorjusqt32bo2ksreg/family1/f97a824041774c5885e858ec64ab9195 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3d7e8197a620488390b93c8af4681fb0_SeqId_53_ 2023-02-09 17:54:52,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5dtro4vr6keqp06d961sl40o1ot16au7n5edu235om6vbqorjusqt32bo2ksreg/family1/f97a824041774c5885e858ec64ab9195 into a146aafefac4ec158955298f90ae2a23/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3d7e8197a620488390b93c8af4681fb0_SeqId_53_ - updating store file list. 2023-02-09 17:54:52,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3d7e8197a620488390b93c8af4681fb0_SeqId_53_ into a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:52,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5dtro4vr6keqp06d961sl40o1ot16au7n5edu235om6vbqorjusqt32bo2ksreg/family1/f97a824041774c5885e858ec64ab9195 into a146aafefac4ec158955298f90ae2a23/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3d7e8197a620488390b93c8af4681fb0_SeqId_53_) 2023-02-09 17:54:52,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5dtro4vr6keqp06d961sl40o1ot16au7n5edu235om6vbqorjusqt32bo2ksreg/family1/f97a824041774c5885e858ec64ab9195 2023-02-09 17:54:52,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:52,885 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:54:52,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112077448a3387bf4a0b96942b8867acbc32 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112077448a3387bf4a0b96942b8867acbc32 2023-02-09 17:54:52,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a268b24250e348d7a425cdda114b2b82 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a268b24250e348d7a425cdda114b2b82 2023-02-09 17:54:52,887 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-09 17:54:52,887 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 17:54:52,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:52,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:52,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:52,889 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:52,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 886 msec 2023-02-09 17:54:52,940 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:52,940 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:52,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:54:52,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:53,351 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 17:54:53,352 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 17:54:53,352 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 17:54:53,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 17:54:53,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE}] 2023-02-09 17:54:53,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE 2023-02-09 17:54:53,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:53,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965293359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965293359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965293359"}]},"ts":"1675965293359"} 2023-02-09 17:54:53,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:53,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a146aafefac4ec158955298f90ae2a23, disabling compactions & flushes 2023-02-09 17:54:53,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. after waiting 0 ms 2023-02-09 17:54:53,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 17:54:53,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a146aafefac4ec158955298f90ae2a23: Waiting for close lock at 1675965293512Running coprocessor pre-close hooks at 1675965293512Disabling compacts and flushes for region at 1675965293512Disabling writes for close at 1675965293512Writing region close event to WAL at 1675965293515 (+3 ms)Running coprocessor post-close hooks at 1675965293519 (+4 ms)Closed at 1675965293519 2023-02-09 17:54:53,519 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: a146aafefac4ec158955298f90ae2a23 to self. 2023-02-09 17:54:53,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,521 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=CLOSED 2023-02-09 17:54:53,521 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965293521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965293521"}]},"ts":"1675965293521"} 2023-02-09 17:54:53,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-09 17:54:53,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218 in 162 msec 2023-02-09 17:54:53,524 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=true 2023-02-09 17:54:53,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:53,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965293674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965293674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965293674"}]},"ts":"1675965293674"} 2023-02-09 17:54:53,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:53,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a146aafefac4ec158955298f90ae2a23, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:53,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:53,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,831 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,832 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:53,832 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1 2023-02-09 17:54:53,832 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a146aafefac4ec158955298f90ae2a23 columnFamilyName family1 2023-02-09 17:54:53,837 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/3d7e8197a620488390b93c8af4681fb0_SeqId_53_ 2023-02-09 17:54:53,840 DEBUG [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/family1/755da3de3950416590f5026c65bb06ef 2023-02-09 17:54:53,840 INFO [StoreOpener-a146aafefac4ec158955298f90ae2a23-1] regionserver.HStore(310): Store=a146aafefac4ec158955298f90ae2a23/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:53,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:54:53,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a146aafefac4ec158955298f90ae2a23; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70760705, jitterRate=0.05441667139530182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:53,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a146aafefac4ec158955298f90ae2a23: Running coprocessor pre-open hook at 1675965293830Writing region info on filesystem at 1675965293830Initializing all the Stores at 1675965293831 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965293831Cleaning up temporary data from old regions at 1675965293842 (+11 ms)Cleaning up detritus from prior splits at 1675965293842Running coprocessor post-open hooks at 1675965293845 (+3 ms)Region opened successfully at 1675965293845 2023-02-09 17:54:53,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23., pid=53, masterSystemTime=1675965293827 2023-02-09 17:54:53,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:54:53,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a146aafefac4ec158955298f90ae2a23, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:53,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675965293847"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965293847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965293847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965293847"}]},"ts":"1675965293847"} 2023-02-09 17:54:53,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-09 17:54:53,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure a146aafefac4ec158955298f90ae2a23, server=jenkins-hbase4.apache.org,42581,1675965218218 in 172 msec 2023-02-09 17:54:53,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-09 17:54:53,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a146aafefac4ec158955298f90ae2a23, REOPEN/MOVE in 493 msec 2023-02-09 17:54:53,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-09 17:54:53,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-02-09 17:54:53,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 912 msec 2023-02-09 17:54:53,854 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:53,855 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:53,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-09 17:54:53,855 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:53,855 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:53,856 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:53,856 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:53,857 INFO [Listener at localhost/44673] compactions.TestMobCompactor(278): alter status finished 2023-02-09 17:54:53,857 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 17:54:53,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:53,859 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:53,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:53,860 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965893860 2023-02-09 17:54:53,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:54:53,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 17:54:53,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:53,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x6a132b4b to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:54:53,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@630ad532, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:54:53,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 17:54:53,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 17:54:53,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:54:53,869 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 17:54:53,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-02-09 17:54:53,917 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 262), OpenFileDescriptor=614 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 361), ProcessCount=168 (was 168), AvailableMemoryMB=3150 (was 3189) 2023-02-09 17:54:53,927 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=168, AvailableMemoryMB=3150 2023-02-09 17:54:53,928 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:53,928 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:53,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 17:54:53,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:53,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:54:53,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-09 17:54:53,931 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:53,931 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:53,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:54:53,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:53,933 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:53,933 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 empty. 2023-02-09 17:54:53,933 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:53,934 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-09 17:54:54,032 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:54,032 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:54,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:54,233 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:54,233 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:54,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:54,341 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 17:54:54,342 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93ac8ace32e8f3a9264c731189dc6e71, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:54:54,534 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:54,535 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:54,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 93ac8ace32e8f3a9264c731189dc6e71, disabling compactions & flushes 2023-02-09 17:54:54,748 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. after waiting 0 ms 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:54,748 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:54,748 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 93ac8ace32e8f3a9264c731189dc6e71: Waiting for close lock at 1675965294748Disabling compacts and flushes for region at 1675965294748Disabling writes for close at 1675965294748Writing region close event to WAL at 1675965294748Closed at 1675965294748 2023-02-09 17:54:54,750 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:54:54,751 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965294751"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965294751"}]},"ts":"1675965294751"} 2023-02-09 17:54:54,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:54:54,753 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:54:54,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965294753"}]},"ts":"1675965294753"} 2023-02-09 17:54:54,754 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-09 17:54:54,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, ASSIGN}] 2023-02-09 17:54:54,758 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, ASSIGN 2023-02-09 17:54:54,759 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:54:54,910 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:54,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965294910"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965294910"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965294910"}]},"ts":"1675965294910"} 2023-02-09 17:54:54,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:54:55,035 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:55,036 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:55,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:55,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:55,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93ac8ace32e8f3a9264c731189dc6e71, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:54:55,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:54:55,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,067 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,068 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:54:55,068 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:54:55,069 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ac8ace32e8f3a9264c731189dc6e71 columnFamilyName family1 2023-02-09 17:54:55,070 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(310): Store=93ac8ace32e8f3a9264c731189dc6e71/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:54:55,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:54:55,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:54:55,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93ac8ace32e8f3a9264c731189dc6e71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61208378, jitterRate=-0.08792409300804138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:54:55,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93ac8ace32e8f3a9264c731189dc6e71: Running coprocessor pre-open hook at 1675965295066Writing region info on filesystem at 1675965295066Initializing all the Stores at 1675965295067 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675965295067Cleaning up temporary data from old regions at 1675965295072 (+5 ms)Cleaning up detritus from prior splits at 1675965295072Running coprocessor post-open hooks at 1675965295076 (+4 ms)Region opened successfully at 1675965295076 2023-02-09 17:54:55,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., pid=57, masterSystemTime=1675965295063 2023-02-09 17:54:55,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:55,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:55,079 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:55,079 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965295078"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965295078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965295078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965295078"}]},"ts":"1675965295078"} 2023-02-09 17:54:55,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-09 17:54:55,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218 in 169 msec 2023-02-09 17:54:55,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-09 17:54:55,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, ASSIGN in 324 msec 2023-02-09 17:54:55,083 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:54:55,083 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965295083"}]},"ts":"1675965295083"} 2023-02-09 17:54:55,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-09 17:54:55,086 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:54:55,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1570 sec 2023-02-09 17:54:56,037 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:56,037 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:56,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 17:54:56,038 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-09 17:54:56,053 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:56,053 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:56,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:56,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,055 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:56,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:56,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:54:56,055 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:54:56,056 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,056 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,058 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,058 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:56,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:56,059 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,059 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:56,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:56,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,059 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,060 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:54:56,060 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:56,060 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:54:56,062 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:56,062 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:56,062 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:56,062 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:54:56,063 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:54:56,481 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130547c67d4bb3a43b0afd61e2c91710fe0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130547c67d4bb3a43b0afd61e2c91710fe0 2023-02-09 17:54:56,885 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/39432f0be71043e6af19aff08b8d2909 2023-02-09 17:54:56,889 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/39432f0be71043e6af19aff08b8d2909 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909 2023-02-09 17:54:56,893 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-09 17:54:56,893 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 830ms, sequenceid=5, compaction requested=false 2023-02-09 17:54:56,893 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:56,894 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:54:56,894 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:54:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:54:56,896 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,896 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:56,896 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,896 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:54:56,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a66a113[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:56,897 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:54:56,897 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,898 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:54:56,898 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:56,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,898 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:56,899 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:56,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:54:56,901 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:54:56,902 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:56,902 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:56,902 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,902 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:56,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:56,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,904 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:56,904 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:56,905 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:56,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:56,910 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:56,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:56,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:56,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:56,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:54:56,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:56,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:56,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:56,911 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,011 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:57,011 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:57,011 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:57,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:57,015 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:57,015 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:57,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:57,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:57,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,017 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:57,017 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:57,017 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:54:57,017 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:54:57,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,019 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:57,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:57,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,019 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:57,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:57,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,020 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,020 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:54:57,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,020 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:54:57,020 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:57,020 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:54:57,021 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:57,021 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:57,021 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:57,021 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:54:57,021 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:54:57,209 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:54:57,432 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286e246c53edd345e1985668efc1329636 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e246c53edd345e1985668efc1329636 2023-02-09 17:54:57,739 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 17:54:57,838 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/c50ee62e241f4662baa43e6ef87868b0 2023-02-09 17:54:57,842 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/c50ee62e241f4662baa43e6ef87868b0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0 2023-02-09 17:54:57,846 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:54:57,847 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 826ms, sequenceid=9, compaction requested=false 2023-02-09 17:54:57,847 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:54:57,847 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:54:57,847 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:54:57,849 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:57,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:54:57,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70d5c4b3[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:57,850 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:54:57,850 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,851 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:54:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:54:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:57,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,852 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:57,854 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,854 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:54:57,854 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:57,854 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:57,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:54:57,856 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:54:57,856 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:57,856 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:57,856 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,856 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:57,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:57,858 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:57,858 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,859 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:57,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:57,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:57,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:57,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:57,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:57,861 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:57,862 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,862 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,862 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:57,862 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:57,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:57,962 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:57,962 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:57,962 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:57,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:57,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:57,966 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:57,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:57,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:57,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,968 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:57,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:57,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:54:57,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:54:57,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,969 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:57,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:57,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:57,969 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,970 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:54:57,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:54:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:54:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:57,971 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:57,971 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:54:57,971 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:58,384 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d673d3340c5e4cce87848de4bfb9d7e1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d673d3340c5e4cce87848de4bfb9d7e1 2023-02-09 17:54:58,789 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/261530d383194a38b9dc4bd57cb37426 2023-02-09 17:54:58,795 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/261530d383194a38b9dc4bd57cb37426 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426 2023-02-09 17:54:58,799 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 17:54:58,800 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 829ms, sequenceid=13, compaction requested=true 2023-02-09 17:54:58,800 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:54:58,800 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:58,800 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:58,800 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:58,800 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,800 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:54:58,800 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:54:58,802 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,802 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:58,803 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,803 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:58,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:54:58,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@199b9d81[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:58,804 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:54:58,804 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,805 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,805 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,805 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:58,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:54:58,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:54:58,805 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:58,806 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:54:58,807 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:58,806 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,807 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:58,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:54:58,809 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:54:58,809 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:58,809 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:58,809 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,809 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:58,810 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,810 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:58,811 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,812 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:58,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:58,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:58,815 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:58,815 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,816 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:58,816 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:58,816 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,816 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,816 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:58,916 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:58,916 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:58,916 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:58,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:58,920 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:58,920 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:58,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:58,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:58,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,922 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:58,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:58,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:54:58,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:54:58,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,922 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,923 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:58,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:58,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:58,924 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:58,924 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:54:58,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:58,925 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:54:58,925 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:58,925 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:54:58,925 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:58,925 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:58,925 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:58,925 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:54:58,925 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:54:59,339 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058735c730d5d54a8a9354dcc095991d9a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058735c730d5d54a8a9354dcc095991d9a 2023-02-09 17:54:59,745 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/071060baaeec4717bd6f71fa6b9ea8c8 2023-02-09 17:54:59,750 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/071060baaeec4717bd6f71fa6b9ea8c8 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8 2023-02-09 17:54:59,753 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 17:54:59,754 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 829ms, sequenceid=17, compaction requested=true 2023-02-09 17:54:59,754 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:54:59,754 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:54:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:54:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:54:59,754 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:54:59,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,756 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:59,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:54:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:59,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:54:59,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4df66e9f[Count = 0] remaining members to acquire global barrier 2023-02-09 17:54:59,757 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:54:59,757 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,762 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:54:59,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:54:59,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:54:59,762 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,762 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:54:59,764 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:54:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:54:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:54:59,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:54:59,766 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:54:59,766 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:54:59,766 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:54:59,766 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,766 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:54:59,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:54:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:54:59,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:54:59,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:59,768 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:54:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,769 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:54:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:59,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:59,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:54:59,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:59,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:54:59,771 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:54:59,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:59,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:54:59,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:54:59,772 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:54:59,872 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:54:59,872 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:59,872 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:59,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:54:59,876 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:54:59,876 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:54:59,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:54:59,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:54:59,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,878 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:54:59,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:59,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:54:59,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:54:59,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,878 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,881 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,881 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:54:59,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:54:59,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:54:59,881 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:54:59,881 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:54:59,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:54:59,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,882 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,882 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:54:59,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:54:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:54:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:54:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:54:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:54:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:54:59,882 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:54:59,882 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:54:59,883 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:00,298 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228cede3fd6f20242e9b86a1ee41fec726e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228cede3fd6f20242e9b86a1ee41fec726e 2023-02-09 17:55:00,703 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/421d6b267ec040608a40187bc8cc58ca 2023-02-09 17:55:00,707 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/421d6b267ec040608a40187bc8cc58ca as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca 2023-02-09 17:55:00,711 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 17:55:00,712 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 829ms, sequenceid=21, compaction requested=true 2023-02-09 17:55:00,712 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:00,712 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:00,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:00,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:00,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:00,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:00,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:00,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d7300b[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:00,715 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:00,715 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,717 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,717 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:00,717 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:00,717 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:00,717 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,717 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:00,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:00,718 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:00,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:00,718 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:00,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:00,720 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:00,721 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:00,721 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:00,721 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,721 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:00,726 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:00,726 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:00,726 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,727 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:00,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:00,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:00,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:00,729 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,729 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,730 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:00,730 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:00,730 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,730 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:00,830 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:00,830 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:00,830 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:00,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:00,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:00,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:00,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:00,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:00,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,836 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:00,836 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:00,836 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:55:00,836 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:55:00,837 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,837 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:00,838 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:00,838 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:00,838 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:00,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:55:00,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:55:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:55:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:55:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:00,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:00,839 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:55:00,840 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:01,251 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318fd6a9dac1284e349393dc1fc1ebe3a4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318fd6a9dac1284e349393dc1fc1ebe3a4 2023-02-09 17:55:01,656 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/9bf56a8435ed4eb2ae68ace8aa49072c 2023-02-09 17:55:01,660 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/9bf56a8435ed4eb2ae68ace8aa49072c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c 2023-02-09 17:55:01,664 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 17:55:01,665 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 825ms, sequenceid=25, compaction requested=true 2023-02-09 17:55:01,665 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:01,665 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:01,665 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:01,665 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:01,665 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,665 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:01,665 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:01,667 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:01,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,667 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:01,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:01,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cf99cbe[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:01,669 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:01,669 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:01,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:01,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:01,671 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,671 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:01,672 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,672 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,672 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:01,672 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:01,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:01,674 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:01,674 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:01,674 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:01,674 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,674 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:01,676 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:01,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:01,676 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,677 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:01,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,682 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,682 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,682 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:01,682 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:01,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:01,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:01,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,683 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:01,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:55:01,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:01,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:01,683 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,783 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:01,784 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:01,784 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:01,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:01,787 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:01,787 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:01,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:01,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:01,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,789 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:01,789 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:01,789 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:55:01,789 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:55:01,790 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,790 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,793 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:01,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:01,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:01,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:01,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:55:01,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:01,794 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:55:01,795 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:01,795 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:55:01,795 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:55:01,795 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:01,795 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:01,795 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:55:01,795 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:02,206 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101886bb4f1773e40d4ae00dc5cdbace9bf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101886bb4f1773e40d4ae00dc5cdbace9bf 2023-02-09 17:55:02,611 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/918f038de39444f6a9a4f8c6d1b85a16 2023-02-09 17:55:02,616 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/918f038de39444f6a9a4f8c6d1b85a16 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16 2023-02-09 17:55:02,620 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 17:55:02,621 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 826ms, sequenceid=29, compaction requested=true 2023-02-09 17:55:02,621 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:02,621 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:02,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:02,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:02,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:02,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,623 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:02,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19cb6535[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:02,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:02,625 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:02,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:02,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:02,626 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,626 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:02,628 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:02,628 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:02,628 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,629 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:02,630 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:02,631 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:02,631 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:02,631 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,631 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:02,632 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,632 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,632 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:02,632 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,633 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,635 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:02,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:02,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:02,635 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:02,736 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:02,736 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:02,736 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:02,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:02,740 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:02,740 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:02,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:02,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:02,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,742 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:02,742 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:02,742 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:55:02,742 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:55:02,742 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,742 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,743 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:02,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:02,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:02,744 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:02,744 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:02,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:02,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:55:02,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:02,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:55:02,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:02,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:55:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:55:02,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:02,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:02,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:55:02,756 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:02,770 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034a7ae073a6ba44f996b5f75ecfd18e63 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034a7ae073a6ba44f996b5f75ecfd18e63 2023-02-09 17:55:03,176 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/d584d64451f94dfa8a2d7cd74687f85a 2023-02-09 17:55:03,181 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/d584d64451f94dfa8a2d7cd74687f85a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a 2023-02-09 17:55:03,185 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 17:55:03,185 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 429ms, sequenceid=33, compaction requested=true 2023-02-09 17:55:03,185 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:03,185 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:03,185 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:03,186 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:03,186 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,186 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:03,186 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:03,188 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,188 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:03,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67b76205[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:03,190 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:03,190 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,191 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,191 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:03,191 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:03,191 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:03,192 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,192 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:03,192 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,192 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:03,194 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:03,194 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:03,194 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:03,194 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,194 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:03,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,196 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:03,196 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,198 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:03,200 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:03,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:55:03,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:03,201 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:03,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:03,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:03,200 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:03,201 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,201 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,201 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:03,201 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:03,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:03,301 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:03,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:03,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:03,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:03,305 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:03,306 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:03,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:03,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:03,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,308 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:03,308 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:03,308 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:55:03,308 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:55:03,309 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,309 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,311 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:03,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:03,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,311 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:03,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:55:03,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:55:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:55:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:55:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:03,312 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:03,313 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:55:03,313 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:03,324 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907dbe89d6016fc4ea0a04056078fd75b4d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907dbe89d6016fc4ea0a04056078fd75b4d 2023-02-09 17:55:03,731 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/a2a7591760b84da0bb39c096b020095e 2023-02-09 17:55:03,735 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/a2a7591760b84da0bb39c096b020095e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e 2023-02-09 17:55:03,739 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 17:55:03,739 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 426ms, sequenceid=37, compaction requested=true 2023-02-09 17:55:03,740 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:03,740 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:03,741 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,742 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,742 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:03,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:03,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c5b5190[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:03,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:03,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,745 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:03,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:03,745 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:03,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:03,747 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:03,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:03,749 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:03,749 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:03,749 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:03,749 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,749 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:03,750 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,750 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:03,750 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:03,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:03,751 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,752 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,754 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:03,754 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:03,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:03,854 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:03,855 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:03,855 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:03,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:03,859 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:03,859 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:03,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,861 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:03,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:03,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 17:55:03,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 17:55:03,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,861 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,865 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,865 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:03,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:03,866 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:03,866 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,867 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,867 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 17:55:03,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 17:55:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 17:55:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:55:03,867 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:03,867 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:03,867 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. started... 2023-02-09 17:55:03,867 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93ac8ace32e8f3a9264c731189dc6e71 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:55:04,279 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b67527280fb343f8ba75face801a50b2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120b67527280fb343f8ba75face801a50b2 2023-02-09 17:55:04,684 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/c5c39b9d4d8343f594bda02f0337c9fe 2023-02-09 17:55:04,689 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/c5c39b9d4d8343f594bda02f0337c9fe as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe 2023-02-09 17:55:04,693 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 17:55:04,694 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93ac8ace32e8f3a9264c731189dc6e71 in 827ms, sequenceid=41, compaction requested=true 2023-02-09 17:55:04,694 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:04,694 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:55:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:55:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 17:55:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 17:55:04,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,696 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:04,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,696 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:04,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 17:55:04,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c573ac9[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:04,698 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 17:55:04,698 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,699 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 17:55:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 17:55:04,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:04,699 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,699 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:04,701 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 17:55:04,701 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:04,701 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,701 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 17:55:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:04,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 17:55:04,703 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 17:55:04,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:04,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:04,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,703 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:04,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:04,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:04,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:04,706 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,707 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:04,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,709 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:04,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 17:55:04,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:04,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 17:55:04,710 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:04,710 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:04,710 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,710 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:04,810 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:04,810 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:04,810 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:04,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:04,812 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:04,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:04,814 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:04,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:04,815 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965904815 2023-02-09 17:55:04,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:55:04,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 17:55:04,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:04,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x743e9601 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:04,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@446c919, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:04,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,662 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032ad50f4c76654d04966a462a01e1898b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032ad50f4c76654d04966a462a01e1898b 2023-02-09 17:55:05,662 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:05,675 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:05,676 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:05,682 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:05,682 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:05,683 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:05,683 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:05,692 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cb915b9dd22249fd82d4881731e3de2c first=Optional[r3] last=Optional[r6] 2023-02-09 17:55:05,693 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cb915b9dd22249fd82d4881731e3de2c}] 2023-02-09 17:55:05,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cb915b9dd22249fd82d4881731e3de2c for inclusion in 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:05,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 17:55:05,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:55:05,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:05,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cb915b9dd22249fd82d4881731e3de2c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nc5bi4o22umn299i7ubf38am1rmo9h1dpjs0mmks0nuddgsb7hgno9pj9os9ufr3/family1/cb915b9dd22249fd82d4881731e3de2c 2023-02-09 17:55:05,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nc5bi4o22umn299i7ubf38am1rmo9h1dpjs0mmks0nuddgsb7hgno9pj9os9ufr3/family1/cb915b9dd22249fd82d4881731e3de2c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_ 2023-02-09 17:55:05,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nc5bi4o22umn299i7ubf38am1rmo9h1dpjs0mmks0nuddgsb7hgno9pj9os9ufr3/family1/cb915b9dd22249fd82d4881731e3de2c into 93ac8ace32e8f3a9264c731189dc6e71/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_ - updating store file list. 2023-02-09 17:55:05,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_ into 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:05,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nc5bi4o22umn299i7ubf38am1rmo9h1dpjs0mmks0nuddgsb7hgno9pj9os9ufr3/family1/cb915b9dd22249fd82d4881731e3de2c into 93ac8ace32e8f3a9264c731189dc6e71/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_) 2023-02-09 17:55:05,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__nc5bi4o22umn299i7ubf38am1rmo9h1dpjs0mmks0nuddgsb7hgno9pj9os9ufr3/family1/cb915b9dd22249fd82d4881731e3de2c 2023-02-09 17:55:05,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:55:05,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:55:05,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 93ac8ace32e8f3a9264c731189dc6e71/family1 is initiating minor compaction 2023-02-09 17:55:05,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@37d369cb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:05,709 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 93ac8ace32e8f3a9264c731189dc6e71/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:05,709 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp, totalSize=50.3 K 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c50ee62e241f4662baa43e6ef87868b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 261530d383194a38b9dc4bd57cb37426, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 071060baaeec4717bd6f71fa6b9ea8c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 421d6b267ec040608a40187bc8cc58ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 9bf56a8435ed4eb2ae68ace8aa49072c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 918f038de39444f6a9a4f8c6d1b85a16, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting d584d64451f94dfa8a2d7cd74687f85a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting a2a7591760b84da0bb39c096b020095e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c5c39b9d4d8343f594bda02f0337c9fe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:55:05,709 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 02492d1d67e944999e60014de42d771d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:55:05,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:05,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:05,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228cede3fd6f20242e9b86a1ee41fec726e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228cede3fd6f20242e9b86a1ee41fec726e 2023-02-09 17:55:05,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318fd6a9dac1284e349393dc1fc1ebe3a4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318fd6a9dac1284e349393dc1fc1ebe3a4 2023-02-09 17:55:05,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101886bb4f1773e40d4ae00dc5cdbace9bf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101886bb4f1773e40d4ae00dc5cdbace9bf 2023-02-09 17:55:05,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034a7ae073a6ba44f996b5f75ecfd18e63 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034a7ae073a6ba44f996b5f75ecfd18e63 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-09 17:55:05,717 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,747 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 93ac8ace32e8f3a9264c731189dc6e71#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:05,787 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052e1f80da7be6459a9cbe3eb908718247 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052e1f80da7be6459a9cbe3eb908718247 2023-02-09 17:55:05,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:05,804 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:05,804 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:05,813 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0e30dc7291a84342853cf34fdf2052c7 first=Optional[r00] last=Optional[r2] 2023-02-09 17:55:05,814 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0e30dc7291a84342853cf34fdf2052c7}] 2023-02-09 17:55:05,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0e30dc7291a84342853cf34fdf2052c7 for inclusion in 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 17:55:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:55:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:05,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0e30dc7291a84342853cf34fdf2052c7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p8jaj8bqqfv3b9o6b7tu6jg3rnufh8ri9kfer4ajcd6kos48a92djk40spoe28uj/family1/0e30dc7291a84342853cf34fdf2052c7 2023-02-09 17:55:05,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p8jaj8bqqfv3b9o6b7tu6jg3rnufh8ri9kfer4ajcd6kos48a92djk40spoe28uj/family1/0e30dc7291a84342853cf34fdf2052c7 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ 2023-02-09 17:55:05,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p8jaj8bqqfv3b9o6b7tu6jg3rnufh8ri9kfer4ajcd6kos48a92djk40spoe28uj/family1/0e30dc7291a84342853cf34fdf2052c7 into 93ac8ace32e8f3a9264c731189dc6e71/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ - updating store file list. 2023-02-09 17:55:05,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ into 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:05,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p8jaj8bqqfv3b9o6b7tu6jg3rnufh8ri9kfer4ajcd6kos48a92djk40spoe28uj/family1/0e30dc7291a84342853cf34fdf2052c7 into 93ac8ace32e8f3a9264c731189dc6e71/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_) 2023-02-09 17:55:05,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p8jaj8bqqfv3b9o6b7tu6jg3rnufh8ri9kfer4ajcd6kos48a92djk40spoe28uj/family1/0e30dc7291a84342853cf34fdf2052c7 2023-02-09 17:55:05,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:05,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:05,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130547c67d4bb3a43b0afd61e2c91710fe0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130547c67d4bb3a43b0afd61e2c91710fe0 2023-02-09 17:55:05,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d673d3340c5e4cce87848de4bfb9d7e1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d673d3340c5e4cce87848de4bfb9d7e1 2023-02-09 17:55:05,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058735c730d5d54a8a9354dcc095991d9a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058735c730d5d54a8a9354dcc095991d9a 2023-02-09 17:55:05,833 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-09 17:55:05,833 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 17:55:05,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:05,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:05,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:05,834 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:05,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.0210 sec 2023-02-09 17:55:05,907 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:05,907 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:05,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 17:55:05,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:06,183 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/c29bb846c69d4a0080e78592e8ad959f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f 2023-02-09 17:55:06,188 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 93ac8ace32e8f3a9264c731189dc6e71/family1 of 93ac8ace32e8f3a9264c731189dc6e71 into c29bb846c69d4a0080e78592e8ad959f(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:06,188 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:06,188 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675965305708; duration=0sec 2023-02-09 17:55:06,188 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:06,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_] to archive 2023-02-09 17:55:06,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:06,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c50ee62e241f4662baa43e6ef87868b0 2023-02-09 17:55:06,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/261530d383194a38b9dc4bd57cb37426 2023-02-09 17:55:06,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/071060baaeec4717bd6f71fa6b9ea8c8 2023-02-09 17:55:06,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/421d6b267ec040608a40187bc8cc58ca 2023-02-09 17:55:06,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/9bf56a8435ed4eb2ae68ace8aa49072c 2023-02-09 17:55:06,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/918f038de39444f6a9a4f8c6d1b85a16 2023-02-09 17:55:06,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/d584d64451f94dfa8a2d7cd74687f85a 2023-02-09 17:55:06,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/a2a7591760b84da0bb39c096b020095e 2023-02-09 17:55:06,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c5c39b9d4d8343f594bda02f0337c9fe 2023-02-09 17:55:06,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/02492d1d67e944999e60014de42d771d_SeqId_44_ 2023-02-09 17:55:06,319 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 17:55:06,320 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:06,320 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 17:55:06,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 17:55:06,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE}] 2023-02-09 17:55:06,324 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE 2023-02-09 17:55:06,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:06,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965306325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965306325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965306325"}]},"ts":"1675965306325"} 2023-02-09 17:55:06,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:06,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93ac8ace32e8f3a9264c731189dc6e71, disabling compactions & flushes 2023-02-09 17:55:06,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. after waiting 0 ms 2023-02-09 17:55:06,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-09 17:55:06,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93ac8ace32e8f3a9264c731189dc6e71: Waiting for close lock at 1675965306479Running coprocessor pre-close hooks at 1675965306479Disabling compacts and flushes for region at 1675965306479Disabling writes for close at 1675965306479Writing region close event to WAL at 1675965306483 (+4 ms)Running coprocessor post-close hooks at 1675965306486 (+3 ms)Closed at 1675965306486 2023-02-09 17:55:06,486 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 93ac8ace32e8f3a9264c731189dc6e71 to self. 2023-02-09 17:55:06,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,488 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=CLOSED 2023-02-09 17:55:06,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965306488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965306488"}]},"ts":"1675965306488"} 2023-02-09 17:55:06,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-09 17:55:06,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218 in 163 msec 2023-02-09 17:55:06,491 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=true 2023-02-09 17:55:06,642 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:06,642 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965306641"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965306641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965306641"}]},"ts":"1675965306641"} 2023-02-09 17:55:06,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:06,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93ac8ace32e8f3a9264c731189dc6e71, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:55:06,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:06,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,799 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,800 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:06,800 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:06,800 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ac8ace32e8f3a9264c731189dc6e71 columnFamilyName family1 2023-02-09 17:55:06,805 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909 2023-02-09 17:55:06,809 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ 2023-02-09 17:55:06,812 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f 2023-02-09 17:55:06,812 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(310): Store=93ac8ace32e8f3a9264c731189dc6e71/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:06,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:06,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93ac8ace32e8f3a9264c731189dc6e71; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75064737, jitterRate=0.11855174601078033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:55:06,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93ac8ace32e8f3a9264c731189dc6e71: Running coprocessor pre-open hook at 1675965306798Writing region info on filesystem at 1675965306798Initializing all the Stores at 1675965306799 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675965306799Cleaning up temporary data from old regions at 1675965306815 (+16 ms)Cleaning up detritus from prior splits at 1675965306815Running coprocessor post-open hooks at 1675965306817 (+2 ms)Region opened successfully at 1675965306817 2023-02-09 17:55:06,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., pid=63, masterSystemTime=1675965306794 2023-02-09 17:55:06,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:06,819 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:55:06,820 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:55:06,820 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1912): 93ac8ace32e8f3a9264c731189dc6e71/family1 is initiating minor compaction (all files) 2023-02-09 17:55:06,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,820 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 93ac8ace32e8f3a9264c731189dc6e71/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:06,820 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp, totalSize=388.1 K 2023-02-09 17:55:06,821 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:06,821 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965306821"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965306821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965306821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965306821"}]},"ts":"1675965306821"} 2023-02-09 17:55:06,821 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 39432f0be71043e6af19aff08b8d2909, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:55:06,821 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting c29bb846c69d4a0080e78592e8ad959f, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:55:06,822 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3fc246b54c8f48958393c641f12cf7d5_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878842209 2023-02-09 17:55:06,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-09 17:55:06,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218 in 179 msec 2023-02-09 17:55:06,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-09 17:55:06,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE in 499 msec 2023-02-09 17:55:06,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-09 17:55:06,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 504 msec 2023-02-09 17:55:06,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 918 msec 2023-02-09 17:55:06,828 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:06,828 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:06,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-09 17:55:06,829 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:06,829 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:06,830 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:06,830 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:06,831 INFO [Listener at localhost/44673] compactions.TestMobCompactor(278): alter status finished 2023-02-09 17:55:06,831 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:06,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:06,834 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:06,836 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 93ac8ace32e8f3a9264c731189dc6e71#family1#compaction#73 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:06,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:06,836 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965906836 2023-02-09 17:55:06,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:55:06,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 17:55:06,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:06,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x06dff6ca to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:06,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4236be1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:06,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:07,667 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284f00d858f6104b87ae00282c38320c5a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284f00d858f6104b87ae00282c38320c5a 2023-02-09 17:55:07,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:07,681 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:07,682 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56346, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:07,688 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:07,688 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:07,689 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:07,691 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55958, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:07,703 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e75d6dc168854df18357a659e08ff7b0 first=Optional[r05] last=Optional[r8] 2023-02-09 17:55:07,704 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=50 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e75d6dc168854df18357a659e08ff7b0}] 2023-02-09 17:55:07,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e75d6dc168854df18357a659e08ff7b0 for inclusion in 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:07,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 17:55:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:55:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:07,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e75d6dc168854df18357a659e08ff7b0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rdp86ogi94ddtn6dtm4d2p42usc4glpt9nmnfaps7fnc046u0mrjmjba55ltchqr/family1/e75d6dc168854df18357a659e08ff7b0 2023-02-09 17:55:07,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rdp86ogi94ddtn6dtm4d2p42usc4glpt9nmnfaps7fnc046u0mrjmjba55ltchqr/family1/e75d6dc168854df18357a659e08ff7b0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/66bf3a3883914665977e230701dc429f_SeqId_52_ 2023-02-09 17:55:07,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rdp86ogi94ddtn6dtm4d2p42usc4glpt9nmnfaps7fnc046u0mrjmjba55ltchqr/family1/e75d6dc168854df18357a659e08ff7b0 into 93ac8ace32e8f3a9264c731189dc6e71/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/66bf3a3883914665977e230701dc429f_SeqId_52_ - updating store file list. 2023-02-09 17:55:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/66bf3a3883914665977e230701dc429f_SeqId_52_ into 93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rdp86ogi94ddtn6dtm4d2p42usc4glpt9nmnfaps7fnc046u0mrjmjba55ltchqr/family1/e75d6dc168854df18357a659e08ff7b0 into 93ac8ace32e8f3a9264c731189dc6e71/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/66bf3a3883914665977e230701dc429f_SeqId_52_) 2023-02-09 17:55:07,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rdp86ogi94ddtn6dtm4d2p42usc4glpt9nmnfaps7fnc046u0mrjmjba55ltchqr/family1/e75d6dc168854df18357a659e08ff7b0 2023-02-09 17:55:07,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:07,721 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:07,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120b67527280fb343f8ba75face801a50b2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120b67527280fb343f8ba75face801a50b2 2023-02-09 17:55:07,723 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e246c53edd345e1985668efc1329636 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286e246c53edd345e1985668efc1329636 2023-02-09 17:55:07,723 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-09 17:55:07,723 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 17:55:07,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:07,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:07,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:07,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:07,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:07,725 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:07,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 893 msec 2023-02-09 17:55:07,787 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:07,787 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6996c339 to 127.0.0.1:59572 2023-02-09 17:55:07,787 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:07,787 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:07,788 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06dff6ca to 127.0.0.1:59572 2023-02-09 17:55:07,788 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:07,793 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:07,794 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743e9601 to 127.0.0.1:59572 2023-02-09 17:55:07,794 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:07,794 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a132b4b to 127.0.0.1:59572 2023-02-09 17:55:07,794 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:07,797 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:07,797 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b6f5b9 to 127.0.0.1:59572 2023-02-09 17:55:07,797 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:07,805 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:07,806 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:07,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-09 17:55:07,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:08,055 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/.tmp/family1/8b0d1fe567a1412d851614704f1b0d84 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/8b0d1fe567a1412d851614704f1b0d84 2023-02-09 17:55:08,059 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 93ac8ace32e8f3a9264c731189dc6e71/family1 of 93ac8ace32e8f3a9264c731189dc6e71 into 8b0d1fe567a1412d851614704f1b0d84(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:08,059 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 93ac8ace32e8f3a9264c731189dc6e71: 2023-02-09 17:55:08,060 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., storeName=93ac8ace32e8f3a9264c731189dc6e71/family1, priority=13, startTime=1675965306818; duration=1sec 2023-02-09 17:55:08,060 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:08,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_] to archive 2023-02-09 17:55:08,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:08,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/39432f0be71043e6af19aff08b8d2909 2023-02-09 17:55:08,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/c29bb846c69d4a0080e78592e8ad959f 2023-02-09 17:55:08,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/3fc246b54c8f48958393c641f12cf7d5_SeqId_46_ 2023-02-09 17:55:08,217 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 17:55:08,218 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 17:55:08,218 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 17:55:08,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 17:55:08,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE}] 2023-02-09 17:55:08,222 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE 2023-02-09 17:55:08,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:08,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965308222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965308222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965308222"}]},"ts":"1675965308222"} 2023-02-09 17:55:08,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:08,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93ac8ace32e8f3a9264c731189dc6e71, disabling compactions & flushes 2023-02-09 17:55:08,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. after waiting 0 ms 2023-02-09 17:55:08,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-09 17:55:08,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93ac8ace32e8f3a9264c731189dc6e71: Waiting for close lock at 1675965308376Running coprocessor pre-close hooks at 1675965308376Disabling compacts and flushes for region at 1675965308376Disabling writes for close at 1675965308376Writing region close event to WAL at 1675965308379 (+3 ms)Running coprocessor post-close hooks at 1675965308383 (+4 ms)Closed at 1675965308383 2023-02-09 17:55:08,383 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 93ac8ace32e8f3a9264c731189dc6e71 to self. 2023-02-09 17:55:08,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=CLOSED 2023-02-09 17:55:08,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965308385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965308385"}]},"ts":"1675965308385"} 2023-02-09 17:55:08,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-09 17:55:08,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218 in 162 msec 2023-02-09 17:55:08,387 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=true 2023-02-09 17:55:08,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:08,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965308538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965308538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965308538"}]},"ts":"1675965308538"} 2023-02-09 17:55:08,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:08,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93ac8ace32e8f3a9264c731189dc6e71, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,696 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,696 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:08,696 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1 2023-02-09 17:55:08,697 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93ac8ace32e8f3a9264c731189dc6e71 columnFamilyName family1 2023-02-09 17:55:08,702 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/66bf3a3883914665977e230701dc429f_SeqId_52_ 2023-02-09 17:55:08,704 DEBUG [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/family1/8b0d1fe567a1412d851614704f1b0d84 2023-02-09 17:55:08,705 INFO [StoreOpener-93ac8ace32e8f3a9264c731189dc6e71-1] regionserver.HStore(310): Store=93ac8ace32e8f3a9264c731189dc6e71/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:08,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:55:08,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93ac8ace32e8f3a9264c731189dc6e71; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70094877, jitterRate=0.04449506103992462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:55:08,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93ac8ace32e8f3a9264c731189dc6e71: Running coprocessor pre-open hook at 1675965308695Writing region info on filesystem at 1675965308695Initializing all the Stores at 1675965308695Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675965308695Cleaning up temporary data from old regions at 1675965308707 (+12 ms)Cleaning up detritus from prior splits at 1675965308707Running coprocessor post-open hooks at 1675965308709 (+2 ms)Region opened successfully at 1675965308709 2023-02-09 17:55:08,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71., pid=69, masterSystemTime=1675965308691 2023-02-09 17:55:08,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:55:08,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93ac8ace32e8f3a9264c731189dc6e71, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:08,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675965308711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965308711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965308711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965308711"}]},"ts":"1675965308711"} 2023-02-09 17:55:08,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-09 17:55:08,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 93ac8ace32e8f3a9264c731189dc6e71, server=jenkins-hbase4.apache.org,42581,1675965218218 in 172 msec 2023-02-09 17:55:08,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-09 17:55:08,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=93ac8ace32e8f3a9264c731189dc6e71, REOPEN/MOVE in 492 msec 2023-02-09 17:55:08,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-09 17:55:08,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 496 msec 2023-02-09 17:55:08,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-02-09 17:55:08,718 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,718 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-09 17:55:08,718 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,719 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,719 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,719 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,720 INFO [Listener at localhost/44673] compactions.TestMobCompactor(278): alter status finished 2023-02-09 17:55:08,721 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 17:55:08,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:08,722 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:08,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:08,723 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965908723 2023-02-09 17:55:08,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:55:08,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 17:55:08,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:08,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x735624d0 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:08,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1124e9b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 17:55:08,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 17:55:08,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:08,730 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 17:55:08,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-02-09 17:55:08,785 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=231 (was 244), OpenFileDescriptor=597 (was 614), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 274), ProcessCount=168 (was 168), AvailableMemoryMB=3114 (was 3150) 2023-02-09 17:55:08,796 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=231, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=168, AvailableMemoryMB=3113 2023-02-09 17:55:08,798 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,798 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 17:55:08,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:08,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:55:08,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-09 17:55:08,802 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,802 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,802 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:55:08,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:08,803 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:08,804 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db empty. 2023-02-09 17:55:08,804 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:08,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 17:55:08,903 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:08,903 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:08,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:09,104 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:09,104 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:09,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:09,212 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:09,213 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => f79d82cda443259c0a51818b8f7fe2db, NAME => 'testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:09,405 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:09,406 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:09,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing f79d82cda443259c0a51818b8f7fe2db, disabling compactions & flushes 2023-02-09 17:55:09,619 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. after waiting 0 ms 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,619 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,619 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for f79d82cda443259c0a51818b8f7fe2db: Waiting for close lock at 1675965309619Disabling compacts and flushes for region at 1675965309619Disabling writes for close at 1675965309619Writing region close event to WAL at 1675965309619Closed at 1675965309619 2023-02-09 17:55:09,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:55:09,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675965309622"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965309622"}]},"ts":"1675965309622"} 2023-02-09 17:55:09,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:55:09,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:55:09,624 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965309624"}]},"ts":"1675965309624"} 2023-02-09 17:55:09,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-09 17:55:09,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, ASSIGN}] 2023-02-09 17:55:09,629 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, ASSIGN 2023-02-09 17:55:09,630 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:09,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f79d82cda443259c0a51818b8f7fe2db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:09,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675965309781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965309781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965309781"}]},"ts":"1675965309781"} 2023-02-09 17:55:09,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure f79d82cda443259c0a51818b8f7fe2db, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:09,907 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:09,907 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:09,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:09,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f79d82cda443259c0a51818b8f7fe2db, NAME => 'testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:55:09,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-09 17:55:09,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-09 17:55:09,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:09,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,940 INFO [StoreOpener-f79d82cda443259c0a51818b8f7fe2db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,941 DEBUG [StoreOpener-f79d82cda443259c0a51818b8f7fe2db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1 2023-02-09 17:55:09,941 DEBUG [StoreOpener-f79d82cda443259c0a51818b8f7fe2db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1 2023-02-09 17:55:09,942 INFO [StoreOpener-f79d82cda443259c0a51818b8f7fe2db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f79d82cda443259c0a51818b8f7fe2db columnFamilyName f1 2023-02-09 17:55:09,943 INFO [StoreOpener-f79d82cda443259c0a51818b8f7fe2db-1] regionserver.HStore(310): Store=f79d82cda443259c0a51818b8f7fe2db/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:09,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:09,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:09,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f79d82cda443259c0a51818b8f7fe2db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69166200, jitterRate=0.03065669536590576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:55:09,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f79d82cda443259c0a51818b8f7fe2db: Running coprocessor pre-open hook at 1675965309939Writing region info on filesystem at 1675965309939Initializing all the Stores at 1675965309940 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965309940Cleaning up temporary data from old regions at 1675965309944 (+4 ms)Cleaning up detritus from prior splits at 1675965309945 (+1 ms)Running coprocessor post-open hooks at 1675965309949 (+4 ms)Region opened successfully at 1675965309949 2023-02-09 17:55:09,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db., pid=73, masterSystemTime=1675965309934 2023-02-09 17:55:09,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:09,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f79d82cda443259c0a51818b8f7fe2db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:09,951 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675965309951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965309951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965309951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965309951"}]},"ts":"1675965309951"} 2023-02-09 17:55:09,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-09 17:55:09,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure f79d82cda443259c0a51818b8f7fe2db, server=jenkins-hbase4.apache.org,42581,1675965218218 in 170 msec 2023-02-09 17:55:09,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-09 17:55:09,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, ASSIGN in 326 msec 2023-02-09 17:55:09,955 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:55:09,955 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965309955"}]},"ts":"1675965309955"} 2023-02-09 17:55:09,956 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-09 17:55:09,959 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:55:09,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1600 sec 2023-02-09 17:55:10,908 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:10,908 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:10,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 17:55:10,909 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-09 17:55:10,909 DEBUG [Listener at localhost/44673] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-09 17:55:10,911 INFO [Listener at localhost/44673] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 17:55:10,913 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-09 17:55:10,914 INFO [Listener at localhost/44673] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 17:55:10,914 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-09 17:55:10,918 INFO [Listener at localhost/44673] regionserver.HRegion(2744): Flushing f79d82cda443259c0a51818b8f7fe2db 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 17:55:11,329 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209ca5d8425b2a24232be7df8f409418f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ca5d8425b2a24232be7df8f409418f34 2023-02-09 17:55:11,735 INFO [Listener at localhost/44673] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp/f1/834d724791c94fdb9733c29aee240a07 2023-02-09 17:55:11,740 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp/f1/834d724791c94fdb9733c29aee240a07 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07 2023-02-09 17:55:11,743 INFO [Listener at localhost/44673] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 17:55:11,744 INFO [Listener at localhost/44673] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for f79d82cda443259c0a51818b8f7fe2db in 826ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:11,744 DEBUG [Listener at localhost/44673] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-09 17:55:11,745 DEBUG [Listener at localhost/44673] regionserver.HRegion(2445): Flush status journal for f79d82cda443259c0a51818b8f7fe2db: 2023-02-09 17:55:11,746 INFO [Listener at localhost/44673] regionserver.HRegion(2744): Flushing f79d82cda443259c0a51818b8f7fe2db 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 17:55:12,016 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:55:12,157 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209744d75f08bc84981a67613277bfef39e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209744d75f08bc84981a67613277bfef39e 2023-02-09 17:55:12,563 INFO [Listener at localhost/44673] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp/f1/feb5ec91e94d4bb280e5a9965010a23d 2023-02-09 17:55:12,567 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp/f1/feb5ec91e94d4bb280e5a9965010a23d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d 2023-02-09 17:55:12,571 INFO [Listener at localhost/44673] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d, entries=1, sequenceid=9, filesize=4.9 K 2023-02-09 17:55:12,571 INFO [Listener at localhost/44673] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for f79d82cda443259c0a51818b8f7fe2db in 825ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:12,572 DEBUG [Listener at localhost/44673] regionserver.HRegion(2445): Flush status journal for f79d82cda443259c0a51818b8f7fe2db: 2023-02-09 17:55:12,573 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-09 17:55:12,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 17:55:12,574 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 17:55:12,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:12,575 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965912575 2023-02-09 17:55:12,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:55:12,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-09 17:55:12,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-09 17:55:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x294711d8 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:12,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f18043b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:12,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 17:55:12,624 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,624 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,675 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,675 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,726 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,726 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,777 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,777 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,828 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,828 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,879 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,879 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,929 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,930 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,980 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:12,980 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,031 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,031 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,082 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,082 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,133 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,133 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,184 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,184 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,235 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,235 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,286 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,286 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,337 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,337 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,387 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,388 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,405 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020903d33f86cba14f959dd309d99fe6c9ca to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020903d33f86cba14f959dd309d99fe6c9ca 2023-02-09 17:55:13,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 17:55:13,418 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:13,419 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:13,425 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:13,425 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:13,426 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:13,427 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:13,436 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/21813ad4573d4a709d86525250784c74 first=Optional[r1] last=Optional[r2] 2023-02-09 17:55:13,436 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{f1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/21813ad4573d4a709d86525250784c74}] 2023-02-09 17:55:13,438 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,439 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/21813ad4573d4a709d86525250784c74 for inclusion in f79d82cda443259c0a51818b8f7fe2db/f1 2023-02-09 17:55:13,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 17:55:13,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:55:13,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for f79d82cda443259c0a51818b8f7fe2db: 2023-02-09 17:55:13,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/21813ad4573d4a709d86525250784c74 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testGetAfterCompaction__1htcrcre1ta1htn7qctep22luhhlvuea2u0lhkmqela689e79542uk11vdf5rni8/f1/21813ad4573d4a709d86525250784c74 2023-02-09 17:55:13,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testGetAfterCompaction__1htcrcre1ta1htn7qctep22luhhlvuea2u0lhkmqela689e79542uk11vdf5rni8/f1/21813ad4573d4a709d86525250784c74 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_ 2023-02-09 17:55:13,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testGetAfterCompaction__1htcrcre1ta1htn7qctep22luhhlvuea2u0lhkmqela689e79542uk11vdf5rni8/f1/21813ad4573d4a709d86525250784c74 into f79d82cda443259c0a51818b8f7fe2db/f1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_ - updating store file list. 2023-02-09 17:55:13,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_ into f79d82cda443259c0a51818b8f7fe2db/f1 2023-02-09 17:55:13,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testGetAfterCompaction__1htcrcre1ta1htn7qctep22luhhlvuea2u0lhkmqela689e79542uk11vdf5rni8/f1/21813ad4573d4a709d86525250784c74 into f79d82cda443259c0a51818b8f7fe2db/f1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_) 2023-02-09 17:55:13,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testGetAfterCompaction__1htcrcre1ta1htn7qctep22luhhlvuea2u0lhkmqela689e79542uk11vdf5rni8/f1/21813ad4573d4a709d86525250784c74 2023-02-09 17:55:13,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): f79d82cda443259c0a51818b8f7fe2db/f1 is initiating minor compaction 2023-02-09 17:55:13,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1479a0f6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:13,450 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f79d82cda443259c0a51818b8f7fe2db/f1 in testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:13,450 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp, totalSize=10.0 K 2023-02-09 17:55:13,450 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting feb5ec91e94d4bb280e5a9965010a23d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:55:13,450 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting b2311b21747444ceb71088ee92c889cc_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:55:13,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 17:55:13,453 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:13,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209744d75f08bc84981a67613277bfef39e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209744d75f08bc84981a67613277bfef39e 2023-02-09 17:55:13,455 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ca5d8425b2a24232be7df8f409418f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ca5d8425b2a24232be7df8f409418f34 2023-02-09 17:55:13,455 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-09 17:55:13,455 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 17:55:13,456 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 17:55:13,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-09 17:55:13,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:55:13,457 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 17:55:13,458 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): f79d82cda443259c0a51818b8f7fe2db#f1#compaction#76 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:13,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 884 msec 2023-02-09 17:55:13,490 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,490 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,490 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,493 DEBUG [Listener at localhost/44673] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 17:55:13,496 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55046, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 17:55:13,497 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42581] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:13,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-09 17:55:13,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 17:55:13,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42581] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 17:55:13,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42581] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. because compaction request was cancelled 2023-02-09 17:55:13,549 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,549 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,549 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,600 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,600 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,600 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,651 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,651 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,651 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,702 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,702 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,702 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,753 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,753 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,753 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,804 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,804 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,804 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,855 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,855 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,855 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,906 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,906 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,906 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,957 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:13,957 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:13,957 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,008 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,008 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,008 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,059 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,059 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,059 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,110 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,110 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,110 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,161 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,161 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,161 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,212 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,212 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,212 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,263 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,263 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,263 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,275 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/.tmp/f1/c0c9ac823f304784bb1bda79bd53db2f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f 2023-02-09 17:55:14,280 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in f79d82cda443259c0a51818b8f7fe2db/f1 of f79d82cda443259c0a51818b8f7fe2db into c0c9ac823f304784bb1bda79bd53db2f(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:14,280 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f79d82cda443259c0a51818b8f7fe2db: 2023-02-09 17:55:14,280 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675965313449; duration=0sec 2023-02-09 17:55:14,281 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:14,314 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,314 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,314 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675965314270; access_time=1675965313455; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,315 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_] to archive 2023-02-09 17:55:14,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:14,365 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,365 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675965313401; access_time=1675965312590; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 17:55:14,366 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675965314270; access_time=1675965313455; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,366 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965312562; access_time=1675965311748; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/feb5ec91e94d4bb280e5a9965010a23d 2023-02-09 17:55:14,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/b2311b21747444ceb71088ee92c889cc_SeqId_12_ 2023-02-09 17:55:14,417 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675965311735; access_time=1675965310920; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,417 INFO [Listener at localhost/44673] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675965314270; access_time=1675965313455; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 17:55:14,533 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,533 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,534 INFO [Listener at localhost/44673] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-09 17:55:14,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-09 17:55:14,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,549 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965314549"}]},"ts":"1675965314549"} 2023-02-09 17:55:14,550 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-09 17:55:14,550 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,550 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 17:55:14,556 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-09 17:55:14,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, UNASSIGN}] 2023-02-09 17:55:14,558 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, UNASSIGN 2023-02-09 17:55:14,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f79d82cda443259c0a51818b8f7fe2db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:14,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675965314559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965314559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965314559"}]},"ts":"1675965314559"} 2023-02-09 17:55:14,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure f79d82cda443259c0a51818b8f7fe2db, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:14,651 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,651 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 17:55:14,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f79d82cda443259c0a51818b8f7fe2db, disabling compactions & flushes 2023-02-09 17:55:14,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. after waiting 0 ms 2023-02-09 17:55:14,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 17:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-09 17:55:14,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db. 2023-02-09 17:55:14,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f79d82cda443259c0a51818b8f7fe2db: Waiting for close lock at 1675965314712Running coprocessor pre-close hooks at 1675965314712Disabling compacts and flushes for region at 1675965314712Disabling writes for close at 1675965314712Writing region close event to WAL at 1675965314713 (+1 ms)Running coprocessor post-close hooks at 1675965314716 (+3 ms)Closed at 1675965314717 (+1 ms) 2023-02-09 17:55:14,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:14,719 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f79d82cda443259c0a51818b8f7fe2db, regionState=CLOSED 2023-02-09 17:55:14,719 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675965314719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965314719"}]},"ts":"1675965314719"} 2023-02-09 17:55:14,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-09 17:55:14,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure f79d82cda443259c0a51818b8f7fe2db, server=jenkins-hbase4.apache.org,42581,1675965218218 in 160 msec 2023-02-09 17:55:14,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-09 17:55:14,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=f79d82cda443259c0a51818b8f7fe2db, UNASSIGN in 164 msec 2023-02-09 17:55:14,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965314723"}]},"ts":"1675965314723"} 2023-02-09 17:55:14,724 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-09 17:55:14,726 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-09 17:55:14,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 186 msec 2023-02-09 17:55:14,852 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,852 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 17:55:14,853 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-09 17:55:14,854 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,854 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-09 17:55:14,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,866 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,867 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 17:55:14,869 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:14,871 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1, FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/recovered.edits] 2023-02-09 17:55:14,874 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/834d724791c94fdb9733c29aee240a07 2023-02-09 17:55:14,875 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/f1/c0c9ac823f304784bb1bda79bd53db2f 2023-02-09 17:55:14,877 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/recovered.edits/15.seqid to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db/recovered.edits/15.seqid 2023-02-09 17:55:14,877 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testGetAfterCompaction/f79d82cda443259c0a51818b8f7fe2db 2023-02-09 17:55:14,877 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 17:55:14,878 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 17:55:14,878 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-09 17:55:14,881 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020903d33f86cba14f959dd309d99fe6c9ca to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020903d33f86cba14f959dd309d99fe6c9ca 2023-02-09 17:55:14,881 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 17:55:14,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,904 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-09 17:55:14,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-09 17:55:14,907 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,908 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-09 17:55:14,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675965314908"}]},"ts":"9223372036854775807"} 2023-02-09 17:55:14,909 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 17:55:14,909 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f79d82cda443259c0a51818b8f7fe2db, NAME => 'testGetAfterCompaction,,1675965308799.f79d82cda443259c0a51818b8f7fe2db.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 17:55:14,909 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-09 17:55:14,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675965314909"}]},"ts":"9223372036854775807"} 2023-02-09 17:55:14,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-09 17:55:14,913 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 17:55:14,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 54 msec 2023-02-09 17:55:14,967 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,968 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 17:55:14,969 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-09 17:55:14,982 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 231) - Thread LEAK? -, OpenFileDescriptor=601 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 222), ProcessCount=168 (was 168), AvailableMemoryMB=3095 (was 3113) 2023-02-09 17:55:14,992 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=3094 2023-02-09 17:55:14,993 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,993 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 17:55:14,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-09 17:55:14,996 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:55:14,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-09 17:55:14,997 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:14,997 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:14,997 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:55:14,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:14,999 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:14,999 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:14,999 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:15,000 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 empty. 2023-02-09 17:55:15,000 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 empty. 2023-02-09 17:55:15,000 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f empty. 2023-02-09 17:55:15,001 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:15,001 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:15,001 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:15,001 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-09 17:55:15,098 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:15,098 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:15,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:15,299 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:15,299 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:15,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:15,409 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:15,411 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => e9b77e263bf3d508cc45bcbf015afb9f, NAME => 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:15,411 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 22c96a7058603f23c359a3e3eedaad85, NAME => 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:15,411 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => b307c18a0ccccb0a839219d40f4730e1, NAME => 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:15,600 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:15,600 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:15,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing b307c18a0ccccb0a839219d40f4730e1, disabling compactions & flushes 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing e9b77e263bf3d508cc45bcbf015afb9f, disabling compactions & flushes 2023-02-09 17:55:15,822 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:15,822 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 22c96a7058603f23c359a3e3eedaad85, disabling compactions & flushes 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. after waiting 1 ms 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:15,822 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:15,823 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for b307c18a0ccccb0a839219d40f4730e1: Waiting for close lock at 1675965315822Disabling compacts and flushes for region at 1675965315822Disabling writes for close at 1675965315823 (+1 ms)Writing region close event to WAL at 1675965315823Closed at 1675965315823 2023-02-09 17:55:15,823 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. after waiting 0 ms 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. after waiting 0 ms 2023-02-09 17:55:15,823 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 22c96a7058603f23c359a3e3eedaad85: Waiting for close lock at 1675965315822Disabling compacts and flushes for region at 1675965315822Disabling writes for close at 1675965315823 (+1 ms)Writing region close event to WAL at 1675965315823Closed at 1675965315823 2023-02-09 17:55:15,823 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:15,823 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for e9b77e263bf3d508cc45bcbf015afb9f: Waiting for close lock at 1675965315822Disabling compacts and flushes for region at 1675965315822Disabling writes for close at 1675965315823 (+1 ms)Writing region close event to WAL at 1675965315823Closed at 1675965315823 2023-02-09 17:55:15,825 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:55:15,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965315826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965315826"}]},"ts":"1675965315826"} 2023-02-09 17:55:15,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965315826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965315826"}]},"ts":"1675965315826"} 2023-02-09 17:55:15,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965315826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965315826"}]},"ts":"1675965315826"} 2023-02-09 17:55:15,828 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 17:55:15,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:55:15,829 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965315828"}]},"ts":"1675965315828"} 2023-02-09 17:55:15,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 17:55:15,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN}] 2023-02-09 17:55:15,836 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN 2023-02-09 17:55:15,836 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN 2023-02-09 17:55:15,836 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN 2023-02-09 17:55:15,836 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:15,836 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:15,836 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:15,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:15,988 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:15,988 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:15,988 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965315988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965315988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965315988"}]},"ts":"1675965315988"} 2023-02-09 17:55:15,988 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965315988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965315988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965315988"}]},"ts":"1675965315988"} 2023-02-09 17:55:15,988 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965315988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965315988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965315988"}]},"ts":"1675965315988"} 2023-02-09 17:55:15,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:15,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:15,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:16,101 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:16,102 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:16,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:16,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:16,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 22c96a7058603f23c359a3e3eedaad85, NAME => 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 17:55:16,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:16,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,146 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,147 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:16,147 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:16,147 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22c96a7058603f23c359a3e3eedaad85 columnFamilyName family1 2023-02-09 17:55:16,149 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(310): Store=22c96a7058603f23c359a3e3eedaad85/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,149 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,150 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2 2023-02-09 17:55:16,150 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2 2023-02-09 17:55:16,150 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22c96a7058603f23c359a3e3eedaad85 columnFamilyName family2 2023-02-09 17:55:16,151 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(310): Store=22c96a7058603f23c359a3e3eedaad85/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:16,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:16,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:16,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 22c96a7058603f23c359a3e3eedaad85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60902461, jitterRate=-0.09248261153697968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:16,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 22c96a7058603f23c359a3e3eedaad85: Running coprocessor pre-open hook at 1675965316145Writing region info on filesystem at 1675965316145Initializing all the Stores at 1675965316146 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316146Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316146Cleaning up temporary data from old regions at 1675965316154 (+8 ms)Cleaning up detritus from prior splits at 1675965316154Running coprocessor post-open hooks at 1675965316158 (+4 ms)Region opened successfully at 1675965316158 2023-02-09 17:55:16,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., pid=85, masterSystemTime=1675965316142 2023-02-09 17:55:16,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:16,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:16,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:16,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b307c18a0ccccb0a839219d40f4730e1, NAME => 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 17:55:16,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:16,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965316160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965316160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965316160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965316160"}]},"ts":"1675965316160"} 2023-02-09 17:55:16,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:16,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,162 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,163 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:16,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-02-09 17:55:16,163 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:16,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218 in 171 msec 2023-02-09 17:55:16,163 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b307c18a0ccccb0a839219d40f4730e1 columnFamilyName family1 2023-02-09 17:55:16,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN in 330 msec 2023-02-09 17:55:16,164 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(310): Store=b307c18a0ccccb0a839219d40f4730e1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,165 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,166 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2 2023-02-09 17:55:16,166 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2 2023-02-09 17:55:16,166 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b307c18a0ccccb0a839219d40f4730e1 columnFamilyName family2 2023-02-09 17:55:16,167 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(310): Store=b307c18a0ccccb0a839219d40f4730e1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:16,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:16,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:16,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b307c18a0ccccb0a839219d40f4730e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75492014, jitterRate=0.12491866946220398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:16,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b307c18a0ccccb0a839219d40f4730e1: Running coprocessor pre-open hook at 1675965316161Writing region info on filesystem at 1675965316161Initializing all the Stores at 1675965316161Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316162 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316162Cleaning up temporary data from old regions at 1675965316169 (+7 ms)Cleaning up detritus from prior splits at 1675965316169Running coprocessor post-open hooks at 1675965316173 (+4 ms)Region opened successfully at 1675965316173 2023-02-09 17:55:16,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., pid=83, masterSystemTime=1675965316142 2023-02-09 17:55:16,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:16,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:16,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:16,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9b77e263bf3d508cc45bcbf015afb9f, NAME => 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 17:55:16,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,175 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:16,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:16,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,175 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965316175"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965316175"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965316175"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965316175"}]},"ts":"1675965316175"} 2023-02-09 17:55:16,176 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,178 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:16,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-02-09 17:55:16,178 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:16,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218 in 186 msec 2023-02-09 17:55:16,178 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9b77e263bf3d508cc45bcbf015afb9f columnFamilyName family1 2023-02-09 17:55:16,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN in 344 msec 2023-02-09 17:55:16,179 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(310): Store=e9b77e263bf3d508cc45bcbf015afb9f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,179 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,180 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2 2023-02-09 17:55:16,181 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2 2023-02-09 17:55:16,181 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9b77e263bf3d508cc45bcbf015afb9f columnFamilyName family2 2023-02-09 17:55:16,182 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(310): Store=e9b77e263bf3d508cc45bcbf015afb9f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:16,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:16,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:16,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:16,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9b77e263bf3d508cc45bcbf015afb9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65824258, jitterRate=-0.019142121076583862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:16,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9b77e263bf3d508cc45bcbf015afb9f: Running coprocessor pre-open hook at 1675965316175Writing region info on filesystem at 1675965316175Initializing all the Stores at 1675965316176 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316176Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965316176Cleaning up temporary data from old regions at 1675965316183 (+7 ms)Cleaning up detritus from prior splits at 1675965316184 (+1 ms)Running coprocessor post-open hooks at 1675965316187 (+3 ms)Region opened successfully at 1675965316187 2023-02-09 17:55:16,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., pid=84, masterSystemTime=1675965316142 2023-02-09 17:55:16,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:16,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:16,190 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:16,190 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965316190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965316190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965316190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965316190"}]},"ts":"1675965316190"} 2023-02-09 17:55:16,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-02-09 17:55:16,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218 in 201 msec 2023-02-09 17:55:16,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-02-09 17:55:16,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN in 359 msec 2023-02-09 17:55:16,194 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:55:16,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965316194"}]},"ts":"1675965316194"} 2023-02-09 17:55:16,195 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 17:55:16,198 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:55:16,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2040 sec 2023-02-09 17:55:17,102 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:17,103 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:17,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 17:55:17,103 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-09 17:55:17,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:17,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:17,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:17,114 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:17,114 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:17,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:17,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 17:55:17,117 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 17:55:17,117 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:17,117 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 17:55:17,117 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 17:55:17,117 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:17,117 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:17,119 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:17,119 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:17,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:17,119 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:17,119 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:17,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:17,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 17:55:17,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 17:55:17,120 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 17:55:17,120 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:17,120 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:17,121 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:17,121 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:17,121 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:17,122 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 22c96a7058603f23c359a3e3eedaad85 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:17,122 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b307c18a0ccccb0a839219d40f4730e1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:17,122 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9b77e263bf3d508cc45bcbf015afb9f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:17,538 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 2023-02-09 17:55:17,539 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd 2023-02-09 17:55:17,542 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 2023-02-09 17:55:17,556 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/600b66ef93ea4c7abf08e47ad14ac910 2023-02-09 17:55:17,558 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/fa2727d9ae9f4ca1a05a5bf84429e13c 2023-02-09 17:55:17,953 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/56167784e38c47569287cc3236253857 2023-02-09 17:55:17,970 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d 2023-02-09 17:55:17,975 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33 2023-02-09 17:55:18,366 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de 2023-02-09 17:55:18,374 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/e65e6d0f5ed94f04bfaa732f387eb82e 2023-02-09 17:55:18,378 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/600b66ef93ea4c7abf08e47ad14ac910 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910 2023-02-09 17:55:18,379 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/05d6f8f37ca5436b9a8c876baf2dbf3f 2023-02-09 17:55:18,382 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:18,382 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/e65e6d0f5ed94f04bfaa732f387eb82e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e 2023-02-09 17:55:18,383 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/fa2727d9ae9f4ca1a05a5bf84429e13c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c 2023-02-09 17:55:18,387 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:18,387 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:18,388 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 22c96a7058603f23c359a3e3eedaad85 in 1267ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:18,388 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 17:55:18,388 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/05d6f8f37ca5436b9a8c876baf2dbf3f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f 2023-02-09 17:55:18,388 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:18,388 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:18,389 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:18,392 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:18,393 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b307c18a0ccccb0a839219d40f4730e1 in 1271ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:18,393 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:18,393 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:18,393 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:18,771 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/3e1e36e3a2704001b5a4707a17859357 2023-02-09 17:55:18,776 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/56167784e38c47569287cc3236253857 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857 2023-02-09 17:55:18,779 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:18,780 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/3e1e36e3a2704001b5a4707a17859357 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357 2023-02-09 17:55:18,783 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:18,784 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e9b77e263bf3d508cc45bcbf015afb9f in 1662ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:18,784 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:18,784 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:18,784 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:18,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:18,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 17:55:18,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 17:55:18,787 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,787 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:18,787 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,787 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:18,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 17:55:18,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e770cbb[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:18,789 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 17:55:18,789 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,790 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 17:55:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 17:55:18,790 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:18,790 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,790 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:18,791 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,791 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 17:55:18,791 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:18,791 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 17:55:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:18,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 17:55:18,793 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 17:55:18,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:18,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:18,793 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 17:55:18,793 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:18,795 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:18,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:18,795 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,796 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,799 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:18,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 17:55:18,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:18,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:18,799 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:18,800 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:18,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:18,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:18,900 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:18,900 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:18,900 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:18,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:18,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:18,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:18,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:18,904 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:18,904 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:18,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:18,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:18,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 17:55:18,907 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 17:55:18,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:18,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 17:55:18,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 17:55:18,908 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,908 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:18,909 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,909 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:18,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:18,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:18,909 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:18,910 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:18,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:18,910 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 17:55:18,910 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 17:55:18,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 17:55:18,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 17:55:18,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:18,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:18,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:18,911 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:18,911 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b307c18a0ccccb0a839219d40f4730e1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:18,911 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:18,911 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9b77e263bf3d508cc45bcbf015afb9f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:18,911 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 22c96a7058603f23c359a3e3eedaad85 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:19,333 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb 2023-02-09 17:55:19,333 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 2023-02-09 17:55:19,333 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 2023-02-09 17:55:19,338 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/0cc3a7a911014a97b2da5423457ef7fe 2023-02-09 17:55:19,739 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/c1cc19d66fdb411aace4e33a90a1f0e3 2023-02-09 17:55:19,739 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/0996e25862e040949178d6e1525b6f00 2023-02-09 17:55:19,752 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d 2023-02-09 17:55:20,153 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534 2023-02-09 17:55:20,153 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e 2023-02-09 17:55:20,166 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/dba7c99a9eae45b880fa4c817f88ccc8 2023-02-09 17:55:20,170 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/0cc3a7a911014a97b2da5423457ef7fe as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe 2023-02-09 17:55:20,173 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:20,174 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/dba7c99a9eae45b880fa4c817f88ccc8 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8 2023-02-09 17:55:20,177 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:20,177 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 22c96a7058603f23c359a3e3eedaad85 in 1266ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:20,178 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:20,178 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:20,178 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:20,218 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:55:20,559 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/ca752206a39245d0ab5771b5ba2661ba 2023-02-09 17:55:20,559 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/d806cec788764cc3a7701ca0938b3ee9 2023-02-09 17:55:20,563 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/0996e25862e040949178d6e1525b6f00 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00 2023-02-09 17:55:20,563 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/c1cc19d66fdb411aace4e33a90a1f0e3 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3 2023-02-09 17:55:20,567 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:20,567 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:20,568 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/ca752206a39245d0ab5771b5ba2661ba as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba 2023-02-09 17:55:20,568 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/d806cec788764cc3a7701ca0938b3ee9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9 2023-02-09 17:55:20,571 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:20,571 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:20,572 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e9b77e263bf3d508cc45bcbf015afb9f in 1661ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:20,572 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b307c18a0ccccb0a839219d40f4730e1 in 1661ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:20,572 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:20,572 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:20,572 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:20,572 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 17:55:20,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 17:55:20,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,574 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:20,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,574 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:20,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 17:55:20,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@520ce03a[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:20,575 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 17:55:20,575 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,577 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,577 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 17:55:20,577 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 17:55:20,577 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:20,577 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,577 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 17:55:20,579 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:20,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:20,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 17:55:20,581 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 17:55:20,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:20,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:20,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 17:55:20,581 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:20,583 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,583 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:20,583 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:20,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,583 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:20,585 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,586 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,587 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:20,586 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:20,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 17:55:20,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:20,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,587 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:20,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:20,687 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:20,687 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:20,688 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:20,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:20,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:20,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:20,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:20,692 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:20,692 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:20,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:20,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:20,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 17:55:20,694 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 17:55:20,694 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:20,694 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 17:55:20,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 17:55:20,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:20,696 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,696 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:20,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:20,696 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:20,696 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:20,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:20,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:20,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:20,697 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 17:55:20,697 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 17:55:20,697 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 17:55:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 17:55:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:20,697 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 17:55:20,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:20,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:20,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:20,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:20,698 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9b77e263bf3d508cc45bcbf015afb9f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:20,698 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 22c96a7058603f23c359a3e3eedaad85 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:20,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:20,699 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:20,699 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:20,699 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b307c18a0ccccb0a839219d40f4730e1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:20,728 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc 2023-02-09 17:55:20,733 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/c98057b116684d1589ccf10c77eaf3c4 2023-02-09 17:55:21,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 2023-02-09 17:55:21,128 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f 2023-02-09 17:55:21,145 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb 2023-02-09 17:55:21,523 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/fe83d74956104583a8d64bf17f773be3 2023-02-09 17:55:21,532 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/5ec2bbfee7cf4af99569d762f0895d07 2023-02-09 17:55:21,549 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/afd8f71a02654ed29ea0f4732c710b5b 2023-02-09 17:55:21,553 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/c98057b116684d1589ccf10c77eaf3c4 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4 2023-02-09 17:55:21,556 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:21,556 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/afd8f71a02654ed29ea0f4732c710b5b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b 2023-02-09 17:55:21,560 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:21,561 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b307c18a0ccccb0a839219d40f4730e1 in 862ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:21,561 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:21,561 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:21,561 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:21,936 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e 2023-02-09 17:55:21,944 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6 2023-02-09 17:55:21,949 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/d3037e58cd9a4bdd83cb6a499868a74c 2023-02-09 17:55:21,952 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/5ec2bbfee7cf4af99569d762f0895d07 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07 2023-02-09 17:55:21,955 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:21,956 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/d3037e58cd9a4bdd83cb6a499868a74c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c 2023-02-09 17:55:21,959 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:21,960 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 22c96a7058603f23c359a3e3eedaad85 in 1262ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:21,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:21,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:22,341 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/65a7f61091294ff2950f3c4036bf89eb 2023-02-09 17:55:22,347 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/fe83d74956104583a8d64bf17f773be3 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3 2023-02-09 17:55:22,350 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:22,350 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/65a7f61091294ff2950f3c4036bf89eb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb 2023-02-09 17:55:22,355 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:22,356 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e9b77e263bf3d508cc45bcbf015afb9f in 1658ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:22,356 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:22,356 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:22,356 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:22,356 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:22,356 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,356 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 17:55:22,356 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 17:55:22,357 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,357 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,358 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:22,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 17:55:22,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54ddfc3a[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:22,359 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 17:55:22,359 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,362 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,363 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,363 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 17:55:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 17:55:22,363 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 17:55:22,366 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:22,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 17:55:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:22,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 17:55:22,369 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 17:55:22,369 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:22,369 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:22,369 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 17:55:22,369 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:22,370 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,370 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:22,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:22,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,370 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:22,371 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:22,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,371 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:22,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:22,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 17:55:22,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:22,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:22,374 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:22,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 17:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:22,375 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:22,375 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:22,374 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,375 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,375 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:22,375 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:22,475 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:22,475 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:22,475 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:22,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:22,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:22,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:22,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:22,480 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:22,480 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:22,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:22,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:22,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 17:55:22,483 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 17:55:22,483 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:22,483 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 17:55:22,483 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 17:55:22,483 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,483 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:22,486 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:22,486 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:22,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:22,486 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:22,486 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:22,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:22,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:22,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:22,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:22,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 17:55:22,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 17:55:22,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 17:55:22,487 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 17:55:22,487 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:22,487 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:22,488 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:22,488 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:22,488 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 22c96a7058603f23c359a3e3eedaad85 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:22,488 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9b77e263bf3d508cc45bcbf015afb9f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:22,488 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:22,488 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b307c18a0ccccb0a839219d40f4730e1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:22,508 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b 2023-02-09 17:55:22,907 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 2023-02-09 17:55:22,907 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 2023-02-09 17:55:22,918 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/17b19f0e9082469a81fd799d144556e5 2023-02-09 17:55:23,312 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/4992f4f9cf064904a9dc46cc307753ec 2023-02-09 17:55:23,312 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/616f5eaa5f164a37a329be7d1e4c16ab 2023-02-09 17:55:23,332 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c 2023-02-09 17:55:23,725 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629 2023-02-09 17:55:23,725 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc 2023-02-09 17:55:23,737 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/a292c83e89e142b9b8f45139dfc54f27 2023-02-09 17:55:23,740 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/17b19f0e9082469a81fd799d144556e5 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5 2023-02-09 17:55:23,744 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:23,744 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/a292c83e89e142b9b8f45139dfc54f27 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27 2023-02-09 17:55:23,747 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:23,748 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 22c96a7058603f23c359a3e3eedaad85 in 1260ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:23,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:23,748 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:23,748 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:24,130 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/aa8d7fb69275404482599cc1f7e3a21a 2023-02-09 17:55:24,130 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/c7c94924c13447b1958a2b95126cc942 2023-02-09 17:55:24,135 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/4992f4f9cf064904a9dc46cc307753ec as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec 2023-02-09 17:55:24,135 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/616f5eaa5f164a37a329be7d1e4c16ab as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab 2023-02-09 17:55:24,138 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:24,138 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:24,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/c7c94924c13447b1958a2b95126cc942 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942 2023-02-09 17:55:24,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/aa8d7fb69275404482599cc1f7e3a21a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a 2023-02-09 17:55:24,145 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:24,145 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:24,145 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b307c18a0ccccb0a839219d40f4730e1 in 1657ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:24,146 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:24,146 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:24,146 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e9b77e263bf3d508cc45bcbf015afb9f in 1658ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:24,146 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:24,146 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 17:55:24,146 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 17:55:24,148 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,148 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:24,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:24,149 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,149 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:24,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 17:55:24,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2129151a[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:24,150 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 17:55:24,150 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,151 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,151 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 17:55:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 17:55:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:24,152 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,152 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:24,154 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 17:55:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:24,154 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 17:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:24,156 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 17:55:24,156 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:24,157 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:24,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 17:55:24,157 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 17:55:24,157 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:24,158 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,158 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:24,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,158 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:24,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:24,159 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,160 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:24,162 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:24,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 17:55:24,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:24,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:24,162 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:24,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:24,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:24,262 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:24,262 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:24,263 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:24,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:24,272 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:24,272 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:24,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:24,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675965324274 (current time:1675965324274). 2023-02-09 17:55:24,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 17:55:24,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] zookeeper.ReadOnlyZKClient(139): Connect 0x5468176b to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:24,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e5f4553, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:24,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:24,288 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:24,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5468176b to 127.0.0.1:59572 2023-02-09 17:55:24,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:24,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 17:55:24,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:24,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:24,298 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:24,299 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675965924299 2023-02-09 17:55:24,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:24,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675965324264 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 17:55:24,300 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:24,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 17:55:24,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-09 17:55:24,302 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 17:55:24,302 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675965924302 2023-02-09 17:55:24,304 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:24,304 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 17:55:24,404 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:24,405 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:24,405 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:24,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:24,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:24,409 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 17:55:24,609 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:24,609 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:24,609 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:24,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:24,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:24,610 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 17:55:24,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675965324264 2023-02-09 17:55:24,710 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675965324264' 2023-02-09 17:55:24,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 17:55:24,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675965324264' starting 'acquire' 2023-02-09 17:55:24,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675965324264', kicking off acquire phase on members. 2023-02-09 17:55:24,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:24,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675965324264 2023-02-09 17:55:24,711 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,711 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 17:55:24,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 17:55:24,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 17:55:24,711 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,711 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675965324264 2023-02-09 17:55:24,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 17:55:24,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675965324264 2023-02-09 17:55:24,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675965324264 from table testCompactionWithHFileLink type FLUSH 2023-02-09 17:55:24,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675965324264 2023-02-09 17:55:24,714 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675965324264' with timeout 300000ms 2023-02-09 17:55:24,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 17:55:24,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675965324264' starting 'acquire' stage 2023-02-09 17:55:24,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675965324264' locally acquired 2023-02-09 17:55:24,715 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (snaptb-1675965324264) in zk 2023-02-09 17:55:24,716 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,716 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 17:55:24,716 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,716 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675965324264' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:24,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:24,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'snaptb-1675965324264' on coordinator 2023-02-09 17:55:24,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@178dc750[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:24,717 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675965324264' starting 'in-barrier' execution. 2023-02-09 17:55:24,717 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,718 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:24,719 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675965324264' received 'reached' from coordinator. 2023-02-09 17:55:24,719 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:24,719 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:24,719 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:24,719 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-09 17:55:24,719 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:24,719 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 17:55:24,719 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:24,720 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:24,721 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.' region-info for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,721 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.' region-info for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,721 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.' region-info for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,726 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 17:55:24,726 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 17:55:24,726 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec] hfiles 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab] hfiles 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5] hfiles 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,729 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,732 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,732 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,732 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a] hfiles 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27] hfiles 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942] hfiles 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,733 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942 for snapshot=snaptb-1675965324264 2023-02-09 17:55:24,910 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:24,910 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:24,910 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:24,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:24,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:24,911 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. completed. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. completed. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. completed. 2023-02-09 17:55:25,139 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675965324264' locally completed 2023-02-09 17:55:25,140 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675965324264' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675965324264' has notified controller of completion 2023-02-09 17:55:25,142 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 17:55:25,142 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675965324264' completed. 2023-02-09 17:55:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675965324264' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:25,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'snaptb-1675965324264', counting down latch. Waiting for 0 more 2023-02-09 17:55:25,145 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675965324264' execution completed 2023-02-09 17:55:25,145 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:25,145 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:25,145 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675965324264 2023-02-09 17:55:25,145 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675965324264including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 17:55:25,146 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,146 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 17:55:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,146 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 17:55:25,147 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,148 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675965324264 2023-02-09 17:55:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675965324264 2023-02-09 17:55:25,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 17:55:25,150 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 17:55:25,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1675965324264 because node does not exist (not an error) 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675965324264 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675965324264/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:25,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675965324264 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:25,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 17:55:25,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675965324264 2023-02-09 17:55:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 17:55:25,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675965324264 2023-02-09 17:55:25,150 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675965324264 2023-02-09 17:55:25,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd] mob files 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 2023-02-09 17:55:25,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629] mob files 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e 2023-02-09 17:55:25,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629 2023-02-09 17:55:25,412 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:25,412 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:25,412 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:25,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:25,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:25,413 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 17:55:25,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675965324264 2023-02-09 17:55:25,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/snaptb-1675965324264 2023-02-09 17:55:26,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/snaptb-1675965324264 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/snaptb-1675965324264 2023-02-09 17:55:26,413 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:26,413 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:26,413 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:26,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:26,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:26,414 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-09 17:55:26,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675965324264 of table testCompactionWithHFileLink completed 2023-02-09 17:55:26,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/snaptb-1675965324264 2023-02-09 17:55:26,818 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/snaptb-1675965324264 2023-02-09 17:55:26,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675965324264 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675965324300Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675965325558 (+1258 ms)Consolidate snapshot: snaptb-1675965324264 at 1675965325559 (+1 ms)Loading Region manifests for snaptb-1675965324264 at 1675965325559Writing data manifest for snaptb-1675965324264 at 1675965325568 (+9 ms)Verifying snapshot: snaptb-1675965324264 at 1675965325974 (+406 ms)Snapshot snaptb-1675965324264 of table testCompactionWithHFileLink completed at 1675965326817 (+843 ms) 2023-02-09 17:55:26,819 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 17:55:26,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.5180 sec 2023-02-09 17:55:28,414 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:28,415 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:28,415 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:28,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:28,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 17:55:28,443 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:28,443 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:28,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:28,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:28,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 17:55:28,446 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 17:55:28,446 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:28,446 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 17:55:28,446 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 17:55:28,446 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:28,446 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:28,447 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:28,447 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:28,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:28,448 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:28,448 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:28,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:28,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 17:55:28,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 17:55:28,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 17:55:28,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 17:55:28,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:28,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 17:55:28,449 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:28,449 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. started... 2023-02-09 17:55:28,449 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9b77e263bf3d508cc45bcbf015afb9f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:28,451 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:28,451 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:28,451 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:28,451 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. started... 2023-02-09 17:55:28,451 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:28,452 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 22c96a7058603f23c359a3e3eedaad85 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:28,452 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. started... 2023-02-09 17:55:28,452 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b307c18a0ccccb0a839219d40f4730e1 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:29,269 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/1f6b33fad61049728810736a0043d55a 2023-02-09 17:55:29,269 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/2802df661eee4a8abe2844eac53953bb 2023-02-09 17:55:29,269 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/8d663f5a803f426ab458f92adefd91c6 2023-02-09 17:55:29,273 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f6b33fad61049728810736a0043d55a 2023-02-09 17:55:29,274 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2802df661eee4a8abe2844eac53953bb 2023-02-09 17:55:29,274 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d663f5a803f426ab458f92adefd91c6 2023-02-09 17:55:30,094 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/4c7090aaedd0476abbd62dfab06fe2a5 2023-02-09 17:55:30,094 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/e8daf329c2e24496b3c11e2d2575ed7c 2023-02-09 17:55:30,094 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/c99cc061219842768f52d0edda975c6b 2023-02-09 17:55:30,097 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c7090aaedd0476abbd62dfab06fe2a5 2023-02-09 17:55:30,097 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8daf329c2e24496b3c11e2d2575ed7c 2023-02-09 17:55:30,097 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c99cc061219842768f52d0edda975c6b 2023-02-09 17:55:30,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/1f6b33fad61049728810736a0043d55a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a 2023-02-09 17:55:30,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/8d663f5a803f426ab458f92adefd91c6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6 2023-02-09 17:55:30,098 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/2802df661eee4a8abe2844eac53953bb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f6b33fad61049728810736a0043d55a 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d663f5a803f426ab458f92adefd91c6 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2802df661eee4a8abe2844eac53953bb 2023-02-09 17:55:30,102 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,102 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/4c7090aaedd0476abbd62dfab06fe2a5 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5 2023-02-09 17:55:30,102 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/e8daf329c2e24496b3c11e2d2575ed7c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c 2023-02-09 17:55:30,103 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/c99cc061219842768f52d0edda975c6b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b 2023-02-09 17:55:30,117 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c7090aaedd0476abbd62dfab06fe2a5 2023-02-09 17:55:30,117 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8daf329c2e24496b3c11e2d2575ed7c 2023-02-09 17:55:30,117 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c99cc061219842768f52d0edda975c6b 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e9b77e263bf3d508cc45bcbf015afb9f in 1669ms, sequenceid=24, compaction requested=true 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b307c18a0ccccb0a839219d40f4730e1 in 1666ms, sequenceid=24, compaction requested=true 2023-02-09 17:55:30,118 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:30,118 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:30,118 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 22c96a7058603f23c359a3e3eedaad85 in 1666ms, sequenceid=24, compaction requested=true 2023-02-09 17:55:30,118 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:30,119 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:30,118 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:30,119 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 17:55:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 17:55:30,124 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 17:55:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2235f8ab[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:30,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 17:55:30,126 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,127 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,127 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 17:55:30,127 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 17:55:30,127 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:30,127 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,127 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:30,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 17:55:30,131 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:30,131 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 17:55:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:30,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 17:55:30,133 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 17:55:30,133 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:30,133 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:30,133 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 17:55:30,133 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:30,136 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:30,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:30,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:30,136 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,137 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 17:55:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,139 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,139 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:30,139 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:30,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 17:55:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:30,139 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:30,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 17:55:30,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:30,140 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:30,140 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 17:55:30,240 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:30,241 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:30,241 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:30,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:30,242 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:30,242 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): e9b77e263bf3d508cc45bcbf015afb9f/family1 is initiating major compaction (all files) 2023-02-09 17:55:30,242 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:30,243 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:30,243 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of e9b77e263bf3d508cc45bcbf015afb9f/family1 in testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:30,243 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp, totalSize=26.7 K 2023-02-09 17:55:30,244 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 56167784e38c47569287cc3236253857, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317110 2023-02-09 17:55:30,244 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 0996e25862e040949178d6e1525b6f00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:30,245 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting fe83d74956104583a8d64bf17f773be3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320689 2023-02-09 17:55:30,245 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 616f5eaa5f164a37a329be7d1e4c16ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:30,245 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 1f6b33fad61049728810736a0043d55a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:30,258 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): e9b77e263bf3d508cc45bcbf015afb9f#family1#compaction#107 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:30,665 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del 2023-02-09 17:55:30,666 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del 2023-02-09 17:55:31,479 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 730eb7c97a4841658f5e466c5da6614f 2023-02-09 17:55:31,480 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/730eb7c97a4841658f5e466c5da6614f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/730eb7c97a4841658f5e466c5da6614f 2023-02-09 17:55:31,483 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 730eb7c97a4841658f5e466c5da6614f 2023-02-09 17:55:31,484 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e9b77e263bf3d508cc45bcbf015afb9f/family1 of e9b77e263bf3d508cc45bcbf015afb9f into 730eb7c97a4841658f5e466c5da6614f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:31,484 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:31,484 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:31,484 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): e9b77e263bf3d508cc45bcbf015afb9f/family2 is initiating major compaction (all files) 2023-02-09 17:55:31,485 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:31,485 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:31,485 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of e9b77e263bf3d508cc45bcbf015afb9f/family2 in testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:31,485 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp, totalSize=25.4 K 2023-02-09 17:55:31,486 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 3e1e36e3a2704001b5a4707a17859357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317110 2023-02-09 17:55:31,486 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting ca752206a39245d0ab5771b5ba2661ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:31,486 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 65a7f61091294ff2950f3c4036bf89eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320689 2023-02-09 17:55:31,487 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting aa8d7fb69275404482599cc1f7e3a21a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:31,487 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 4c7090aaedd0476abbd62dfab06fe2a5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:31,498 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): e9b77e263bf3d508cc45bcbf015afb9f#family2#compaction#108 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:31,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a] to archive 2023-02-09 17:55:31,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:31,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/56167784e38c47569287cc3236253857 2023-02-09 17:55:31,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/0996e25862e040949178d6e1525b6f00 2023-02-09 17:55:31,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/fe83d74956104583a8d64bf17f773be3 2023-02-09 17:55:31,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/616f5eaa5f164a37a329be7d1e4c16ab 2023-02-09 17:55:31,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/1f6b33fad61049728810736a0043d55a 2023-02-09 17:55:31,906 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del 2023-02-09 17:55:31,906 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del 2023-02-09 17:55:32,719 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7124a825f7347f8afa890f077ded31c 2023-02-09 17:55:32,719 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/e7124a825f7347f8afa890f077ded31c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/e7124a825f7347f8afa890f077ded31c 2023-02-09 17:55:32,723 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7124a825f7347f8afa890f077ded31c 2023-02-09 17:55:32,723 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e9b77e263bf3d508cc45bcbf015afb9f/family2 of e9b77e263bf3d508cc45bcbf015afb9f into e7124a825f7347f8afa890f077ded31c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:32,724 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:32,724 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:32,724 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 22c96a7058603f23c359a3e3eedaad85/family1 is initiating major compaction (all files) 2023-02-09 17:55:32,724 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:32,724 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:32,725 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 22c96a7058603f23c359a3e3eedaad85/family1 in testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:32,725 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp, totalSize=26.7 K 2023-02-09 17:55:32,725 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 600b66ef93ea4c7abf08e47ad14ac910, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317111 2023-02-09 17:55:32,725 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 0cc3a7a911014a97b2da5423457ef7fe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:32,726 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 5ec2bbfee7cf4af99569d762f0895d07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:32,726 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 17b19f0e9082469a81fd799d144556e5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:32,726 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8d663f5a803f426ab458f92adefd91c6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:32,736 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 22c96a7058603f23c359a3e3eedaad85#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:32,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5] to archive 2023-02-09 17:55:32,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:32,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/3e1e36e3a2704001b5a4707a17859357 2023-02-09 17:55:32,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/ca752206a39245d0ab5771b5ba2661ba 2023-02-09 17:55:32,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/65a7f61091294ff2950f3c4036bf89eb 2023-02-09 17:55:32,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/aa8d7fb69275404482599cc1f7e3a21a 2023-02-09 17:55:32,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/4c7090aaedd0476abbd62dfab06fe2a5 2023-02-09 17:55:33,145 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del 2023-02-09 17:55:33,145 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del 2023-02-09 17:55:33,959 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a50d1188e5b649b9b9f3986589a2fc6f 2023-02-09 17:55:33,960 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/a50d1188e5b649b9b9f3986589a2fc6f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/a50d1188e5b649b9b9f3986589a2fc6f 2023-02-09 17:55:33,963 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a50d1188e5b649b9b9f3986589a2fc6f 2023-02-09 17:55:33,964 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 22c96a7058603f23c359a3e3eedaad85/family1 of 22c96a7058603f23c359a3e3eedaad85 into a50d1188e5b649b9b9f3986589a2fc6f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:33,964 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:33,964 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:33,964 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 22c96a7058603f23c359a3e3eedaad85/family2 is initiating major compaction (all files) 2023-02-09 17:55:33,964 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:33,964 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:33,965 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 22c96a7058603f23c359a3e3eedaad85/family2 in testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:33,965 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp, totalSize=25.4 K 2023-02-09 17:55:33,965 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting e65e6d0f5ed94f04bfaa732f387eb82e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317111 2023-02-09 17:55:33,965 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting dba7c99a9eae45b880fa4c817f88ccc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:33,966 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting d3037e58cd9a4bdd83cb6a499868a74c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:33,966 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting a292c83e89e142b9b8f45139dfc54f27, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:33,966 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c99cc061219842768f52d0edda975c6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:33,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6] to archive 2023-02-09 17:55:33,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:33,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/600b66ef93ea4c7abf08e47ad14ac910 2023-02-09 17:55:33,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/0cc3a7a911014a97b2da5423457ef7fe 2023-02-09 17:55:33,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/5ec2bbfee7cf4af99569d762f0895d07 2023-02-09 17:55:33,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/17b19f0e9082469a81fd799d144556e5 2023-02-09 17:55:33,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/8d663f5a803f426ab458f92adefd91c6 2023-02-09 17:55:33,977 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 22c96a7058603f23c359a3e3eedaad85#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:34,384 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del 2023-02-09 17:55:34,385 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del 2023-02-09 17:55:35,198 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e7b1208aab84a91887ada25c5f5fc70 2023-02-09 17:55:35,199 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/9e7b1208aab84a91887ada25c5f5fc70 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/9e7b1208aab84a91887ada25c5f5fc70 2023-02-09 17:55:35,202 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e7b1208aab84a91887ada25c5f5fc70 2023-02-09 17:55:35,203 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 22c96a7058603f23c359a3e3eedaad85/family2 of 22c96a7058603f23c359a3e3eedaad85 into 9e7b1208aab84a91887ada25c5f5fc70(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:35,203 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:35,203 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:35,203 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): b307c18a0ccccb0a839219d40f4730e1/family1 is initiating major compaction (all files) 2023-02-09 17:55:35,204 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:35,204 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:35,204 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of b307c18a0ccccb0a839219d40f4730e1/family1 in testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:35,204 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp, totalSize=26.7 K 2023-02-09 17:55:35,205 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting fa2727d9ae9f4ca1a05a5bf84429e13c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317112 2023-02-09 17:55:35,205 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c1cc19d66fdb411aace4e33a90a1f0e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:35,205 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c98057b116684d1589ccf10c77eaf3c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:35,206 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 4992f4f9cf064904a9dc46cc307753ec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:35,206 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 2802df661eee4a8abe2844eac53953bb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:35,217 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): b307c18a0ccccb0a839219d40f4730e1#family1#compaction#111 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:35,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b] to archive 2023-02-09 17:55:35,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:35,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/e65e6d0f5ed94f04bfaa732f387eb82e 2023-02-09 17:55:35,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/dba7c99a9eae45b880fa4c817f88ccc8 2023-02-09 17:55:35,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/d3037e58cd9a4bdd83cb6a499868a74c 2023-02-09 17:55:35,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/a292c83e89e142b9b8f45139dfc54f27 2023-02-09 17:55:35,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/c99cc061219842768f52d0edda975c6b 2023-02-09 17:55:35,624 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del 2023-02-09 17:55:35,625 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del 2023-02-09 17:55:36,439 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff052fed1954414780df30cb0b1d30dc 2023-02-09 17:55:36,439 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/ff052fed1954414780df30cb0b1d30dc as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/ff052fed1954414780df30cb0b1d30dc 2023-02-09 17:55:36,443 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff052fed1954414780df30cb0b1d30dc 2023-02-09 17:55:36,444 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b307c18a0ccccb0a839219d40f4730e1/family1 of b307c18a0ccccb0a839219d40f4730e1 into ff052fed1954414780df30cb0b1d30dc(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:36,444 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:36,445 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:36,445 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): b307c18a0ccccb0a839219d40f4730e1/family2 is initiating major compaction (all files) 2023-02-09 17:55:36,445 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:36,445 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:36,446 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of b307c18a0ccccb0a839219d40f4730e1/family2 in testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:36,446 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp, totalSize=25.4 K 2023-02-09 17:55:36,446 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 05d6f8f37ca5436b9a8c876baf2dbf3f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317112 2023-02-09 17:55:36,447 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting d806cec788764cc3a7701ca0938b3ee9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:36,447 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting afd8f71a02654ed29ea0f4732c710b5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:36,447 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c7c94924c13447b1958a2b95126cc942, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:36,448 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting e8daf329c2e24496b3c11e2d2575ed7c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 17:55:36,459 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): b307c18a0ccccb0a839219d40f4730e1#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:36,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb] to archive 2023-02-09 17:55:36,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:36,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/fa2727d9ae9f4ca1a05a5bf84429e13c 2023-02-09 17:55:36,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c1cc19d66fdb411aace4e33a90a1f0e3 2023-02-09 17:55:36,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/c98057b116684d1589ccf10c77eaf3c4 2023-02-09 17:55:36,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/4992f4f9cf064904a9dc46cc307753ec 2023-02-09 17:55:36,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/2802df661eee4a8abe2844eac53953bb 2023-02-09 17:55:36,866 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del 2023-02-09 17:55:36,867 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del 2023-02-09 17:55:37,680 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4242f3df2dab47d287824862a295caa6 2023-02-09 17:55:37,681 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/4242f3df2dab47d287824862a295caa6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/4242f3df2dab47d287824862a295caa6 2023-02-09 17:55:37,683 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4242f3df2dab47d287824862a295caa6 2023-02-09 17:55:37,684 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b307c18a0ccccb0a839219d40f4730e1/family2 of b307c18a0ccccb0a839219d40f4730e1 into 4242f3df2dab47d287824862a295caa6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:37,685 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:37,690 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:37,694 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:37,698 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:37,699 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:37,705 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:55:37,735 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 17:55:37,737 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del 2023-02-09 17:55:37,740 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del 2023-02-09 17:55:37,743 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del 2023-02-09 17:55:37,743 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:37,744 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(139): Connect 0x7bace953 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:37,748 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f1f0589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:37,749 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:37,749 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:37,749 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:37,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c] to archive 2023-02-09 17:55:37,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:37,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/05d6f8f37ca5436b9a8c876baf2dbf3f 2023-02-09 17:55:37,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/d806cec788764cc3a7701ca0938b3ee9 2023-02-09 17:55:37,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/afd8f71a02654ed29ea0f4732c710b5b 2023-02-09 17:55:37,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/c7c94924c13447b1958a2b95126cc942 2023-02-09 17:55:37,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/e8daf329c2e24496b3c11e2d2575ed7c 2023-02-09 17:55:38,215 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51 2023-02-09 17:55:38,216 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,228 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:38,231 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:38,236 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,237 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,237 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:38,239 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:38,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/32ee3708434b4f86b9fc27f40cff8b62 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 17:55:38,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/32ee3708434b4f86b9fc27f40cff8b62}] 2023-02-09 17:55:38,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/32ee3708434b4f86b9fc27f40cff8b62 for inclusion in 22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 17:55:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 17:55:38,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:38,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/32ee3708434b4f86b9fc27f40cff8b62 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__i57d9c834tl5fi0neggofitbv3oap3c1ha3c7gqgovl2pglemt695nsg1jbdmrii/family1/32ee3708434b4f86b9fc27f40cff8b62 2023-02-09 17:55:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__i57d9c834tl5fi0neggofitbv3oap3c1ha3c7gqgovl2pglemt695nsg1jbdmrii/family1/32ee3708434b4f86b9fc27f40cff8b62 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ 2023-02-09 17:55:38,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__i57d9c834tl5fi0neggofitbv3oap3c1ha3c7gqgovl2pglemt695nsg1jbdmrii/family1/32ee3708434b4f86b9fc27f40cff8b62 into 22c96a7058603f23c359a3e3eedaad85/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ - updating store file list. 2023-02-09 17:55:38,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ into 22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:38,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__i57d9c834tl5fi0neggofitbv3oap3c1ha3c7gqgovl2pglemt695nsg1jbdmrii/family1/32ee3708434b4f86b9fc27f40cff8b62 into 22c96a7058603f23c359a3e3eedaad85/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_) 2023-02-09 17:55:38,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__i57d9c834tl5fi0neggofitbv3oap3c1ha3c7gqgovl2pglemt695nsg1jbdmrii/family1/32ee3708434b4f86b9fc27f40cff8b62 2023-02-09 17:55:38,262 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,262 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,263 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb 2023-02-09 17:55:38,264 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b 2023-02-09 17:55:38,265 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f 2023-02-09 17:55:38,266 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 2023-02-09 17:55:38,266 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:38,266 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 17:55:38,266 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:38,612 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb 2023-02-09 17:55:38,613 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,618 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa 2023-02-09 17:55:38,618 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,630 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,630 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,633 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,633 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,640 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ef8b282048c64601be663755cfa26990 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 17:55:38,642 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ef8b282048c64601be663755cfa26990}] 2023-02-09 17:55:38,644 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e090b737dddb469591dd60c38889a8fe first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 17:55:38,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e090b737dddb469591dd60c38889a8fe}] 2023-02-09 17:55:38,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ef8b282048c64601be663755cfa26990 for inclusion in e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:38,646 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e090b737dddb469591dd60c38889a8fe for inclusion in b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 17:55:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 17:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 17:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 17:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ef8b282048c64601be663755cfa26990 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__odfvl4iqc0bunno6p5bi1ik7n0v0kaj5ljcm2jfq2s5eficrtb3fmp1vbbv3g0g/family1/ef8b282048c64601be663755cfa26990 2023-02-09 17:55:38,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e090b737dddb469591dd60c38889a8fe to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__aa3qq2cmm6qkg3n7av442kufe11kab3mbobr2ojfdqq346csp0e7mnlikv5m0vjc/family1/e090b737dddb469591dd60c38889a8fe 2023-02-09 17:55:38,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__odfvl4iqc0bunno6p5bi1ik7n0v0kaj5ljcm2jfq2s5eficrtb3fmp1vbbv3g0g/family1/ef8b282048c64601be663755cfa26990 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ 2023-02-09 17:55:38,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__aa3qq2cmm6qkg3n7av442kufe11kab3mbobr2ojfdqq346csp0e7mnlikv5m0vjc/family1/e090b737dddb469591dd60c38889a8fe as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ 2023-02-09 17:55:38,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__odfvl4iqc0bunno6p5bi1ik7n0v0kaj5ljcm2jfq2s5eficrtb3fmp1vbbv3g0g/family1/ef8b282048c64601be663755cfa26990 into e9b77e263bf3d508cc45bcbf015afb9f/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ - updating store file list. 2023-02-09 17:55:38,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__aa3qq2cmm6qkg3n7av442kufe11kab3mbobr2ojfdqq346csp0e7mnlikv5m0vjc/family1/e090b737dddb469591dd60c38889a8fe into b307c18a0ccccb0a839219d40f4730e1/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ - updating store file list. 2023-02-09 17:55:38,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ into b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:38,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__aa3qq2cmm6qkg3n7av442kufe11kab3mbobr2ojfdqq346csp0e7mnlikv5m0vjc/family1/e090b737dddb469591dd60c38889a8fe into b307c18a0ccccb0a839219d40f4730e1/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_) 2023-02-09 17:55:38,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ into e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:38,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__odfvl4iqc0bunno6p5bi1ik7n0v0kaj5ljcm2jfq2s5eficrtb3fmp1vbbv3g0g/family1/ef8b282048c64601be663755cfa26990 into e9b77e263bf3d508cc45bcbf015afb9f/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_) 2023-02-09 17:55:38,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__aa3qq2cmm6qkg3n7av442kufe11kab3mbobr2ojfdqq346csp0e7mnlikv5m0vjc/family1/e090b737dddb469591dd60c38889a8fe 2023-02-09 17:55:38,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__odfvl4iqc0bunno6p5bi1ik7n0v0kaj5ljcm2jfq2s5eficrtb3fmp1vbbv3g0g/family1/ef8b282048c64601be663755cfa26990 2023-02-09 17:55:38,657 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,657 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,658 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,658 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,659 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 2023-02-09 17:55:38,659 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 2023-02-09 17:55:38,660 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 2023-02-09 17:55:38,660 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 2023-02-09 17:55:38,661 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 2023-02-09 17:55:38,661 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 2023-02-09 17:55:38,662 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd 2023-02-09 17:55:38,662 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:38,662 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 17:55:38,662 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc 2023-02-09 17:55:38,662 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:38,662 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 17:55:38,662 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:38,663 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:38,663 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:38,663 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:38,663 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del] 2023-02-09 17:55:38,663 DEBUG [Listener at localhost/44673] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,665 DEBUG [Listener at localhost/44673] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020992b96e5ab4c546128c443004c28ebf0b_del 2023-02-09 17:55:38,665 INFO [Listener at localhost/44673] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 17:55:38,665 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del] 2023-02-09 17:55:38,665 DEBUG [Listener at localhost/44673] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,666 DEBUG [Listener at localhost/44673] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209091ead53522448d5b90ac7c3d6785385_del 2023-02-09 17:55:38,666 INFO [Listener at localhost/44673] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 17:55:38,666 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del] 2023-02-09 17:55:38,667 DEBUG [Listener at localhost/44673] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:38,668 DEBUG [Listener at localhost/44673] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a02acb34d4f64ff79154cca96bbd08c7_del 2023-02-09 17:55:38,668 INFO [Listener at localhost/44673] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 17:55:38,671 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:38,673 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:38,676 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:38,677 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:38,682 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,682 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,683 INFO [Listener at localhost/44673] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-09 17:55:38,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-09 17:55:38,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-09 17:55:38,685 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,685 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 17:55:38,686 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965338686"}]},"ts":"1675965338686"} 2023-02-09 17:55:38,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-09 17:55:38,689 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-09 17:55:38,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, UNASSIGN}] 2023-02-09 17:55:38,691 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, UNASSIGN 2023-02-09 17:55:38,691 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, UNASSIGN 2023-02-09 17:55:38,691 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, UNASSIGN 2023-02-09 17:55:38,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:38,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:38,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:38,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965338691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965338691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965338691"}]},"ts":"1675965338691"} 2023-02-09 17:55:38,692 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965338691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965338691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965338691"}]},"ts":"1675965338691"} 2023-02-09 17:55:38,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965338691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965338691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965338691"}]},"ts":"1675965338691"} 2023-02-09 17:55:38,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:38,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:38,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:38,786 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,786 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 17:55:38,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:38,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9b77e263bf3d508cc45bcbf015afb9f, disabling compactions & flushes 2023-02-09 17:55:38,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:38,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:38,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. after waiting 0 ms 2023-02-09 17:55:38,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:38,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 17:55:38,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:38,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9b77e263bf3d508cc45bcbf015afb9f: Waiting for close lock at 1675965338845Running coprocessor pre-close hooks at 1675965338845Disabling compacts and flushes for region at 1675965338845Disabling writes for close at 1675965338845Writing region close event to WAL at 1675965338846 (+1 ms)Running coprocessor post-close hooks at 1675965338849 (+3 ms)Closed at 1675965338850 (+1 ms) 2023-02-09 17:55:38,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:38,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 22c96a7058603f23c359a3e3eedaad85, disabling compactions & flushes 2023-02-09 17:55:38,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. after waiting 0 ms 2023-02-09 17:55:38,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:38,852 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=CLOSED 2023-02-09 17:55:38,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965338852"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965338852"}]},"ts":"1675965338852"} 2023-02-09 17:55:38,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-02-09 17:55:38,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218 in 159 msec 2023-02-09 17:55:38,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 17:55:38,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, UNASSIGN in 165 msec 2023-02-09 17:55:38,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:38,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 22c96a7058603f23c359a3e3eedaad85: Waiting for close lock at 1675965338851Running coprocessor pre-close hooks at 1675965338851Disabling compacts and flushes for region at 1675965338851Disabling writes for close at 1675965338851Writing region close event to WAL at 1675965338852 (+1 ms)Running coprocessor post-close hooks at 1675965338855 (+3 ms)Closed at 1675965338856 (+1 ms) 2023-02-09 17:55:38,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:38,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b307c18a0ccccb0a839219d40f4730e1, disabling compactions & flushes 2023-02-09 17:55:38,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. after waiting 0 ms 2023-02-09 17:55:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:38,857 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=CLOSED 2023-02-09 17:55:38,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965338857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965338857"}]},"ts":"1675965338857"} 2023-02-09 17:55:38,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-02-09 17:55:38,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218 in 166 msec 2023-02-09 17:55:38,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 17:55:38,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, UNASSIGN in 171 msec 2023-02-09 17:55:38,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:38,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b307c18a0ccccb0a839219d40f4730e1: Waiting for close lock at 1675965338857Running coprocessor pre-close hooks at 1675965338857Disabling compacts and flushes for region at 1675965338857Disabling writes for close at 1675965338857Writing region close event to WAL at 1675965338858 (+1 ms)Running coprocessor post-close hooks at 1675965338861 (+3 ms)Closed at 1675965338861 2023-02-09 17:55:38,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:38,862 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=CLOSED 2023-02-09 17:55:38,863 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965338862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965338862"}]},"ts":"1675965338862"} 2023-02-09 17:55:38,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-02-09 17:55:38,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218 in 171 msec 2023-02-09 17:55:38,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-02-09 17:55:38,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, UNASSIGN in 176 msec 2023-02-09 17:55:38,866 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965338866"}]},"ts":"1675965338866"} 2023-02-09 17:55:38,867 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-09 17:55:38,875 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-09 17:55:38,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 192 msec 2023-02-09 17:55:38,988 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:38,988 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:38,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 17:55:38,989 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-09 17:55:39,149 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:39,149 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:39,149 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x735624d0 to 127.0.0.1:59572 2023-02-09 17:55:39,150 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:39,149 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-09 17:55:39,156 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:39,157 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bace953 to 127.0.0.1:59572 2023-02-09 17:55:39,157 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:39,161 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:55:39,161 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x294711d8 to 127.0.0.1:59572 2023-02-09 17:55:39,161 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:39,169 INFO [Listener at localhost/44673] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:39,169 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:39,170 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:39,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:39,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675965339171 (current time:1675965339171). 2023-02-09 17:55:39,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 17:55:39,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] zookeeper.ReadOnlyZKClient(139): Connect 0x18c5d5c8 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:39,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@780ade5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:39,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:39,193 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:39,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18c5d5c8 to 127.0.0.1:59572 2023-02-09 17:55:39,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:55:39,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 17:55:39,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:39,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:39,199 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:39,200 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675965939200 2023-02-09 17:55:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:39,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675965324264-1675965339169 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 17:55:39,201 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:39,201 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 17:55:39,301 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:39,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:39,301 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:39,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:39,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:39,303 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 17:55:39,503 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:39,503 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:39,503 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:39,504 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 17:55:39,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 17:55:39,614 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/ff052fed1954414780df30cb0b1d30dc] hfiles 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/ff052fed1954414780df30cb0b1d30dc 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/a50d1188e5b649b9b9f3986589a2fc6f] hfiles 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/730eb7c97a4841658f5e466c5da6614f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_] hfiles 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/a50d1188e5b649b9b9f3986589a2fc6f 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/730eb7c97a4841658f5e466c5da6614f 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ 2023-02-09 17:55:39,617 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb] hfiles 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/4242f3df2dab47d287824862a295caa6] hfiles 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/4242f3df2dab47d287824862a295caa6 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/e7124a825f7347f8afa890f077ded31c] hfiles 2023-02-09 17:55:39,618 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/e7124a825f7347f8afa890f077ded31c 2023-02-09 17:55:39,620 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/9e7b1208aab84a91887ada25c5f5fc70] hfiles 2023-02-09 17:55:39,620 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/9e7b1208aab84a91887ada25c5f5fc70 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629] hfiles 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302090efae7c341f542d087d4f7f20623776d 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302091ccb68355dfd4633b570da36c08a3df6 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209408eeca524334204a0c007e2d168c14d 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209f572b845cd374ee68877786f3702f40c 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020918825f5b5acb46f6a380d30603c39bcc 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302093529853efc964790aa9b31cb78413b33 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020960c1c149c1ea41f19fdd5e5613df3534 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209dcfb512460b546e3b35db39a95c229fb 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092b7690d34e7f4bb48abfde8ebe0e61de 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b92223e306844bd2a814f31cd40a9b4e 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209bf614420cc3f4bf78a00e27bb14a3a5e 2023-02-09 17:55:39,626 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209d7d21255bc0b4d8cadf44e28fc576629 2023-02-09 17:55:39,755 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 17:55:39,804 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:39,805 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:39,805 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:39,806 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 17:55:40,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-09 17:55:40,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:40,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:40,306 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:40,306 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:40,306 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:40,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:40,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 17:55:40,307 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 17:55:40,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675965324264-1675965339169 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:40,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675965324264-1675965339169 of table testCompactionWithHFileLink completed 2023-02-09 17:55:40,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:40,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:40,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675965324264-1675965339169 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675965339201Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675965339612 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675965324264-1675965339169 at 1675965340055 (+443 ms)Loading Region manifests for hbase-failsafe-snaptb-1675965324264-1675965339169 at 1675965340055Writing data manifest for hbase-failsafe-snaptb-1675965324264-1675965339169 at 1675965340058 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1675965324264-1675965339169 at 1675965340464 (+406 ms)Snapshot hbase-failsafe-snaptb-1675965324264-1675965339169 of table testCompactionWithHFileLink completed at 1675965340892 (+428 ms) 2023-02-09 17:55:40,894 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 17:55:40,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6970 sec 2023-02-09 17:55:41,307 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 17:55:41,307 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,307 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 17:55:41,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675965324264-1675965339169 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 17:55:41,309 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,309 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675965324264" table: "testCompactionWithHFileLink" creation_time: 1675965324274 type: FLUSH version: 2 ttl: 0 ) 2023-02-09 17:55:41,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675965324264 as table=testCompactionWithHFileLink 2023-02-09 17:55:41,346 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,346 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 17:55:41,447 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,447 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 17:55:41,648 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,648 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 17:55:41,753 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 17:55:41,754 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:41,754 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 17:55:41,755 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 17:55:41,760 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675965324264" table: "testCompactionWithHFileLink" creation_time: 1675965324274 type: FLUSH version: 2 ttl: 0 2023-02-09 17:55:41,760 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink 2023-02-09 17:55:41,766 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-09 17:55:41,771 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302094f542e14a8404b2f9e6b578ad4355faa 2023-02-09 17:55:41,772 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302091a4af3dc3ebc48cb9e275ced55896e51 2023-02-09 17:55:41,773 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302095d8fdafd0f0e4a858c699c2f6a821dcb 2023-02-09 17:55:41,773 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,776 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,779 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,782 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,785 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,788 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,790 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,793 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,796 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,799 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,801 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,804 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd of snapshot=snaptb-1675965324264 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 17:55:41,808 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020905ee9d63ef084136a38ec4ffa7f0da4e_del 2023-02-09 17:55:41,809 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302090aa09f4ec188433c93d099891b56d651_del 2023-02-09 17:55:41,810 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209938e5548313a4825b8ef1b5f0c4cd172_del 2023-02-09 17:55:41,810 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:41,810 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:41,811 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:41,814 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/a50d1188e5b649b9b9f3986589a2fc6f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/a50d1188e5b649b9b9f3986589a2fc6f 2023-02-09 17:55:41,814 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/d3f3406740484ab684ca3722989eb599_SeqId_29_ 2023-02-09 17:55:41,814 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/987cbe34b80d4bcfb8e3ef286098cfe3_SeqId_29_ 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/2d99b8afba444d3d8494f553a2746dc8_SeqId_29_ 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 600b66ef93ea4c7abf08e47ad14ac910 of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/730eb7c97a4841658f5e466c5da6614f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/730eb7c97a4841658f5e466c5da6614f 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/ff052fed1954414780df30cb0b1d30dc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/ff052fed1954414780df30cb0b1d30dc 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fa2727d9ae9f4ca1a05a5bf84429e13c of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,815 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56167784e38c47569287cc3236253857 of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,818 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0cc3a7a911014a97b2da5423457ef7fe of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,819 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c1cc19d66fdb411aace4e33a90a1f0e3 of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,819 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0996e25862e040949178d6e1525b6f00 of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,822 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5ec2bbfee7cf4af99569d762f0895d07 of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,822 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fe83d74956104583a8d64bf17f773be3 of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,822 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c98057b116684d1589ccf10c77eaf3c4 of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,825 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 17b19f0e9082469a81fd799d144556e5 of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,825 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 616f5eaa5f164a37a329be7d1e4c16ab of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,826 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4992f4f9cf064904a9dc46cc307753ec of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,834 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/9e7b1208aab84a91887ada25c5f5fc70 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/9e7b1208aab84a91887ada25c5f5fc70 2023-02-09 17:55:41,834 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e65e6d0f5ed94f04bfaa732f387eb82e of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,838 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/e7124a825f7347f8afa890f077ded31c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/e7124a825f7347f8afa890f077ded31c 2023-02-09 17:55:41,838 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3e1e36e3a2704001b5a4707a17859357 of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,838 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/4242f3df2dab47d287824862a295caa6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/4242f3df2dab47d287824862a295caa6 2023-02-09 17:55:41,838 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 05d6f8f37ca5436b9a8c876baf2dbf3f of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,847 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dba7c99a9eae45b880fa4c817f88ccc8 of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,848 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d806cec788764cc3a7701ca0938b3ee9 of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,848 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca752206a39245d0ab5771b5ba2661ba of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,851 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d3037e58cd9a4bdd83cb6a499868a74c of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,851 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink afd8f71a02654ed29ea0f4732c710b5b of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,852 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 65a7f61091294ff2950f3c4036bf89eb of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,854 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a292c83e89e142b9b8f45139dfc54f27 of snapshot=snaptb-1675965324264 to region=22c96a7058603f23c359a3e3eedaad85 table=testCompactionWithHFileLink 2023-02-09 17:55:41,854 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c7c94924c13447b1958a2b95126cc942 of snapshot=snaptb-1675965324264 to region=b307c18a0ccccb0a839219d40f4730e1 table=testCompactionWithHFileLink 2023-02-09 17:55:41,855 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aa8d7fb69275404482599cc1f7e3a21a of snapshot=snaptb-1675965324264 to region=e9b77e263bf3d508cc45bcbf015afb9f table=testCompactionWithHFileLink 2023-02-09 17:55:41,858 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675965324264" table: "testCompactionWithHFileLink" creation_time: 1675965324274 type: FLUSH version: 2 ttl: 0 2023-02-09 17:55:41,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675965341859"}]},"ts":"9223372036854775807"} 2023-02-09 17:55:41,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675965341859"}]},"ts":"9223372036854775807"} 2023-02-09 17:55:41,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675965341859"}]},"ts":"9223372036854775807"} 2023-02-09 17:55:41,861 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-09 17:55:41,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 22c96a7058603f23c359a3e3eedaad85, NAME => 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b307c18a0ccccb0a839219d40f4730e1, NAME => 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => e9b77e263bf3d508cc45bcbf015afb9f, NAME => 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.', STARTKEY => '', ENDKEY => '1'}] 2023-02-09 17:55:41,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965341860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965341860"}]},"ts":"1675965341860"} 2023-02-09 17:55:41,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965341860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965341860"}]},"ts":"1675965341860"} 2023-02-09 17:55:41,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965341860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965341860"}]},"ts":"1675965341860"} 2023-02-09 17:55:41,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 17:55:41,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-09 17:55:41,863 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 22c96a7058603f23c359a3e3eedaad85, NAME => 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b307c18a0ccccb0a839219d40f4730e1, NAME => 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => e9b77e263bf3d508cc45bcbf015afb9f, NAME => 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.', STARTKEY => '', ENDKEY => '1'}] 2023-02-09 17:55:41,864 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675965324264 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-09 17:55:41,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675965324264" table: "testCompactionWithHFileLink" creation_time: 1675965324274 type: FLUSH version: 2 ttl: 0 ) in 529 msec 2023-02-09 17:55:41,949 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,949 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 17:55:41,950 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-09 17:55:41,950 INFO [Listener at localhost/44673] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:41,951 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,951 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1675965324264-1675965339169" 2023-02-09 17:55:41,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675965324264-1675965339169 2023-02-09 17:55:41,958 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,959 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,959 INFO [Listener at localhost/44673] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-09 17:55:41,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-09 17:55:41,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-09 17:55:41,971 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:41,971 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:41,971 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-09 17:55:41,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965341971"}]},"ts":"1675965341971"} 2023-02-09 17:55:41,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 17:55:41,972 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 17:55:41,974 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-09 17:55:41,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN}] 2023-02-09 17:55:41,975 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN 2023-02-09 17:55:41,975 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN 2023-02-09 17:55:41,975 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN 2023-02-09 17:55:41,976 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 17:55:41,976 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 17:55:41,976 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 17:55:42,072 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:42,072 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:42,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 17:55:42,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,128 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,128 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965342127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965342127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965342127"}]},"ts":"1675965342127"} 2023-02-09 17:55:42,128 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965342127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965342127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965342127"}]},"ts":"1675965342127"} 2023-02-09 17:55:42,128 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965342127"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965342127"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965342127"}]},"ts":"1675965342127"} 2023-02-09 17:55:42,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:42,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:42,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:42,273 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:42,273 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:42,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 17:55:42,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:42,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9b77e263bf3d508cc45bcbf015afb9f, NAME => 'testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 17:55:42,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:42,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,285 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,285 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:42,285 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:42,286 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9b77e263bf3d508cc45bcbf015afb9f columnFamilyName family1 2023-02-09 17:55:42,300 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00 2023-02-09 17:55:42,306 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857 2023-02-09 17:55:42,311 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab 2023-02-09 17:55:42,315 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3 2023-02-09 17:55:42,315 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(310): Store=e9b77e263bf3d508cc45bcbf015afb9f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,316 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,316 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2 2023-02-09 17:55:42,316 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2 2023-02-09 17:55:42,317 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9b77e263bf3d508cc45bcbf015afb9f columnFamilyName family2 2023-02-09 17:55:42,323 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357 2023-02-09 17:55:42,327 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb 2023-02-09 17:55:42,332 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a 2023-02-09 17:55:42,336 DEBUG [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba 2023-02-09 17:55:42,336 INFO [StoreOpener-e9b77e263bf3d508cc45bcbf015afb9f-1] regionserver.HStore(310): Store=e9b77e263bf3d508cc45bcbf015afb9f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:42,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:55:42,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9b77e263bf3d508cc45bcbf015afb9f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73721539, jitterRate=0.09853653609752655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:42,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9b77e263bf3d508cc45bcbf015afb9f: Running coprocessor pre-open hook at 1675965342284Writing region info on filesystem at 1675965342284Initializing all the Stores at 1675965342284Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342284Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342284Cleaning up temporary data from old regions at 1675965342338 (+54 ms)Cleaning up detritus from prior splits at 1675965342339 (+1 ms)Running coprocessor post-open hooks at 1675965342341 (+2 ms)Region opened successfully at 1675965342341 2023-02-09 17:55:42,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., pid=101, masterSystemTime=1675965342281 2023-02-09 17:55:42,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:42,342 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 17:55:42,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:42,342 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 17:55:42,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:42,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:42,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:42,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b307c18a0ccccb0a839219d40f4730e1, NAME => 'testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 17:55:42,344 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=e9b77e263bf3d508cc45bcbf015afb9f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965342344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965342344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965342344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965342344"}]},"ts":"1675965342344"} 2023-02-09 17:55:42,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,345 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 17:55:42,345 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1912): e9b77e263bf3d508cc45bcbf015afb9f/family1 is initiating minor compaction (all files) 2023-02-09 17:55:42,345 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e9b77e263bf3d508cc45bcbf015afb9f/family1 in testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:42,345 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 17:55:42,345 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp, totalSize=21.6 K 2023-02-09 17:55:42,345 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1912): e9b77e263bf3d508cc45bcbf015afb9f/family2 is initiating minor compaction (all files) 2023-02-09 17:55:42,346 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2258): Starting compaction of e9b77e263bf3d508cc45bcbf015afb9f/family2 in testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:55:42,346 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp, totalSize=20.4 K 2023-02-09 17:55:42,346 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317110 2023-02-09 17:55:42,346 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,346 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317110 2023-02-09 17:55:42,347 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:42,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-02-09 17:55:42,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure e9b77e263bf3d508cc45bcbf015afb9f, server=jenkins-hbase4.apache.org,42581,1675965218218 in 217 msec 2023-02-09 17:55:42,347 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:42,348 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:42,348 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:42,348 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320689 2023-02-09 17:55:42,348 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320689 2023-02-09 17:55:42,348 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b307c18a0ccccb0a839219d40f4730e1 columnFamilyName family1 2023-02-09 17:55:42,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e9b77e263bf3d508cc45bcbf015afb9f, ASSIGN in 373 msec 2023-02-09 17:55:42,349 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:42,349 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:42,363 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec 2023-02-09 17:55:42,378 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3 2023-02-09 17:55:42,383 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] throttle.PressureAwareThroughputController(145): e9b77e263bf3d508cc45bcbf015afb9f#family2#compaction#113 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:42,384 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): e9b77e263bf3d508cc45bcbf015afb9f#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:42,384 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4 2023-02-09 17:55:42,392 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c 2023-02-09 17:55:42,392 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(310): Store=b307c18a0ccccb0a839219d40f4730e1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,392 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,393 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2 2023-02-09 17:55:42,393 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2 2023-02-09 17:55:42,393 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b307c18a0ccccb0a839219d40f4730e1 columnFamilyName family2 2023-02-09 17:55:42,398 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f 2023-02-09 17:55:42,402 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b 2023-02-09 17:55:42,406 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942 2023-02-09 17:55:42,410 DEBUG [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9 2023-02-09 17:55:42,410 INFO [StoreOpener-b307c18a0ccccb0a839219d40f4730e1-1] regionserver.HStore(310): Store=b307c18a0ccccb0a839219d40f4730e1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:42,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:55:42,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b307c18a0ccccb0a839219d40f4730e1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63049524, jitterRate=-0.060488879680633545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:42,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b307c18a0ccccb0a839219d40f4730e1: Running coprocessor pre-open hook at 1675965342345Writing region info on filesystem at 1675965342345Initializing all the Stores at 1675965342346 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342346Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342346Cleaning up temporary data from old regions at 1675965342412 (+66 ms)Cleaning up detritus from prior splits at 1675965342412Running coprocessor post-open hooks at 1675965342414 (+2 ms)Region opened successfully at 1675965342414 2023-02-09 17:55:42,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., pid=103, masterSystemTime=1675965342281 2023-02-09 17:55:42,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 17:55:42,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:42,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:42,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 22c96a7058603f23c359a3e3eedaad85, NAME => 'testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 17:55:42,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b307c18a0ccccb0a839219d40f4730e1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675965342416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965342416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965342416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965342416"}]},"ts":"1675965342416"} 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,417 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,418 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:42,418 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:42,418 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22c96a7058603f23c359a3e3eedaad85 columnFamilyName family1 2023-02-09 17:55:42,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-02-09 17:55:42,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure b307c18a0ccccb0a839219d40f4730e1, server=jenkins-hbase4.apache.org,42581,1675965218218 in 287 msec 2023-02-09 17:55:42,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b307c18a0ccccb0a839219d40f4730e1, ASSIGN in 444 msec 2023-02-09 17:55:42,424 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe 2023-02-09 17:55:42,427 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5 2023-02-09 17:55:42,433 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07 2023-02-09 17:55:42,438 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910 2023-02-09 17:55:42,438 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(310): Store=22c96a7058603f23c359a3e3eedaad85/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,438 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,439 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2 2023-02-09 17:55:42,439 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2 2023-02-09 17:55:42,439 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22c96a7058603f23c359a3e3eedaad85 columnFamilyName family2 2023-02-09 17:55:42,446 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27 2023-02-09 17:55:42,451 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c 2023-02-09 17:55:42,461 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8 2023-02-09 17:55:42,467 DEBUG [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(539): loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e 2023-02-09 17:55:42,467 INFO [StoreOpener-22c96a7058603f23c359a3e3eedaad85-1] regionserver.HStore(310): Store=22c96a7058603f23c359a3e3eedaad85/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:42,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:42,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:55:42,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 22c96a7058603f23c359a3e3eedaad85; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73605555, jitterRate=0.09680823981761932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:42,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 22c96a7058603f23c359a3e3eedaad85: Running coprocessor pre-open hook at 1675965342416Writing region info on filesystem at 1675965342416Initializing all the Stores at 1675965342417 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342417Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965342417Cleaning up temporary data from old regions at 1675965342469 (+52 ms)Cleaning up detritus from prior splits at 1675965342470 (+1 ms)Running coprocessor post-open hooks at 1675965342472 (+2 ms)Region opened successfully at 1675965342472 2023-02-09 17:55:42,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., pid=102, masterSystemTime=1675965342281 2023-02-09 17:55:42,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 17:55:42,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 17:55:42,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:42,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:42,474 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=22c96a7058603f23c359a3e3eedaad85, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:42,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965342474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965342474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965342474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965342474"}]},"ts":"1675965342474"} 2023-02-09 17:55:42,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-02-09 17:55:42,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 22c96a7058603f23c359a3e3eedaad85, server=jenkins-hbase4.apache.org,42581,1675965218218 in 346 msec 2023-02-09 17:55:42,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-09 17:55:42,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=22c96a7058603f23c359a3e3eedaad85, ASSIGN in 503 msec 2023-02-09 17:55:42,480 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965342480"}]},"ts":"1675965342480"} 2023-02-09 17:55:42,481 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 17:55:42,483 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-09 17:55:42,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 519 msec 2023-02-09 17:55:42,574 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:42,574 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:42,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 17:55:42,575 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-09 17:55:42,588 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:42,594 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:42,600 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:42,601 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:42,606 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:55:42,619 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 17:55:42,619 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:42,619 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(139): Connect 0x7be576da to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:42,624 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e863ffd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:42,624 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:42,624 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:42,624 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:43,495 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095e4c21ea95c94099a7453a4a6152e8d0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095e4c21ea95c94099a7453a4a6152e8d0 2023-02-09 17:55:43,495 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209d47daf8f938942708eb840995815ab94 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209d47daf8f938942708eb840995815ab94 2023-02-09 17:55:43,496 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,496 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,497 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209491ab765c2944464bae9f43ad29b46a1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209491ab765c2944464bae9f43ad29b46a1 2023-02-09 17:55:43,497 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,511 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:43,520 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:43,540 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,540 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,540 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,541 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:43,542 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,547 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:43,548 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,548 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,550 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,550 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,572 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/7a16d0ca2e35406a80d3c6d115c0c41e first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-09 17:55:43,573 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=32 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/7a16d0ca2e35406a80d3c6d115c0c41e}] 2023-02-09 17:55:43,574 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e3eaf2543e0c443c9d75e02c3421a06d first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-09 17:55:43,575 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e3eaf2543e0c443c9d75e02c3421a06d}] 2023-02-09 17:55:43,575 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/b12143f352f040738aa34ccd5cd3abe9 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-09 17:55:43,576 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/b12143f352f040738aa34ccd5cd3abe9}] 2023-02-09 17:55:43,582 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e3eaf2543e0c443c9d75e02c3421a06d for inclusion in b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:43,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/b12143f352f040738aa34ccd5cd3abe9 for inclusion in 22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:43,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/7a16d0ca2e35406a80d3c6d115c0c41e for inclusion in e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-09 17:55:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 17:55:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-09 17:55:43,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 17:55:43,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:43,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e3eaf2543e0c443c9d75e02c3421a06d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__cm7ebhnbht6m6l8r5mf2q65gs98qhohc40dv7ouoihqivaclg3r03rp46g1hp2b3/family1/e3eaf2543e0c443c9d75e02c3421a06d 2023-02-09 17:55:43,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/b12143f352f040738aa34ccd5cd3abe9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__1vfrt67t6aedi5gf6pmj8nmt30d1pcl8heiibkesiemn0bd3rq6o15f0klo4g0vj/family1/b12143f352f040738aa34ccd5cd3abe9 2023-02-09 17:55:43,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__cm7ebhnbht6m6l8r5mf2q65gs98qhohc40dv7ouoihqivaclg3r03rp46g1hp2b3/family1/e3eaf2543e0c443c9d75e02c3421a06d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_ 2023-02-09 17:55:43,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__1vfrt67t6aedi5gf6pmj8nmt30d1pcl8heiibkesiemn0bd3rq6o15f0klo4g0vj/family1/b12143f352f040738aa34ccd5cd3abe9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_ 2023-02-09 17:55:43,590 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__cm7ebhnbht6m6l8r5mf2q65gs98qhohc40dv7ouoihqivaclg3r03rp46g1hp2b3/family1/e3eaf2543e0c443c9d75e02c3421a06d into b307c18a0ccccb0a839219d40f4730e1/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_ - updating store file list. 2023-02-09 17:55:43,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__1vfrt67t6aedi5gf6pmj8nmt30d1pcl8heiibkesiemn0bd3rq6o15f0klo4g0vj/family1/b12143f352f040738aa34ccd5cd3abe9 into 22c96a7058603f23c359a3e3eedaad85/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_ - updating store file list. 2023-02-09 17:55:43,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-09 17:55:43,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 17:55:43,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/7a16d0ca2e35406a80d3c6d115c0c41e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__4er5ga96lf5c42glgpj7rmprg81hnrm0l68bk7n00cc48d0330hur9jr6d48qkpa/family1/7a16d0ca2e35406a80d3c6d115c0c41e 2023-02-09 17:55:43,598 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_ into b307c18a0ccccb0a839219d40f4730e1/family1 2023-02-09 17:55:43,598 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__cm7ebhnbht6m6l8r5mf2q65gs98qhohc40dv7ouoihqivaclg3r03rp46g1hp2b3/family1/e3eaf2543e0c443c9d75e02c3421a06d into b307c18a0ccccb0a839219d40f4730e1/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_) 2023-02-09 17:55:43,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__cm7ebhnbht6m6l8r5mf2q65gs98qhohc40dv7ouoihqivaclg3r03rp46g1hp2b3/family1/e3eaf2543e0c443c9d75e02c3421a06d 2023-02-09 17:55:43,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:43,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__4er5ga96lf5c42glgpj7rmprg81hnrm0l68bk7n00cc48d0330hur9jr6d48qkpa/family1/7a16d0ca2e35406a80d3c6d115c0c41e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/8461179f0f494b20b02ac5368378af65_SeqId_34_ 2023-02-09 17:55:43,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__4er5ga96lf5c42glgpj7rmprg81hnrm0l68bk7n00cc48d0330hur9jr6d48qkpa/family1/7a16d0ca2e35406a80d3c6d115c0c41e into e9b77e263bf3d508cc45bcbf015afb9f/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/8461179f0f494b20b02ac5368378af65_SeqId_34_ - updating store file list. 2023-02-09 17:55:43,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_ into 22c96a7058603f23c359a3e3eedaad85/family1 2023-02-09 17:55:43,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__1vfrt67t6aedi5gf6pmj8nmt30d1pcl8heiibkesiemn0bd3rq6o15f0klo4g0vj/family1/b12143f352f040738aa34ccd5cd3abe9 into 22c96a7058603f23c359a3e3eedaad85/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_) 2023-02-09 17:55:43,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__1vfrt67t6aedi5gf6pmj8nmt30d1pcl8heiibkesiemn0bd3rq6o15f0klo4g0vj/family1/b12143f352f040738aa34ccd5cd3abe9 2023-02-09 17:55:43,607 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family1/410cdecb9818433ead7d326859eed5cb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/410cdecb9818433ead7d326859eed5cb 2023-02-09 17:55:43,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/8461179f0f494b20b02ac5368378af65_SeqId_34_ into e9b77e263bf3d508cc45bcbf015afb9f/family1 2023-02-09 17:55:43,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-09 17:55:43,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__4er5ga96lf5c42glgpj7rmprg81hnrm0l68bk7n00cc48d0330hur9jr6d48qkpa/family1/7a16d0ca2e35406a80d3c6d115c0c41e into e9b77e263bf3d508cc45bcbf015afb9f/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/8461179f0f494b20b02ac5368378af65_SeqId_34_) 2023-02-09 17:55:43,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.HStore(1912): b307c18a0ccccb0a839219d40f4730e1/family1 is initiating minor compaction (all files) 2023-02-09 17:55:43,607 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/.tmp/family2/c18214cb0b2c464d83ee637c2205745b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/c18214cb0b2c464d83ee637c2205745b 2023-02-09 17:55:43,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e416f4b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-09 17:55:43,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:43,610 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,610 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:43,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-09 17:55:43,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.HStore(1912): 22c96a7058603f23c359a3e3eedaad85/family1 is initiating minor compaction (all files) 2023-02-09 17:55:43,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32481b2f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-09 17:55:43,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testCompactionWithHFileLink__4er5ga96lf5c42glgpj7rmprg81hnrm0l68bk7n00cc48d0330hur9jr6d48qkpa/family1/7a16d0ca2e35406a80d3c6d115c0c41e 2023-02-09 17:55:43,612 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 17:55:43,613 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e9b77e263bf3d508cc45bcbf015afb9f/family1 of e9b77e263bf3d508cc45bcbf015afb9f into 410cdecb9818433ead7d326859eed5cb(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:43,613 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:43,613 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., storeName=e9b77e263bf3d508cc45bcbf015afb9f/family1, priority=12, startTime=1675965342342; duration=1sec 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e9b77e263bf3d508cc45bcbf015afb9f/family2 of e9b77e263bf3d508cc45bcbf015afb9f into c18214cb0b2c464d83ee637c2205745b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:43,614 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-09 17:55:43,614 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for e9b77e263bf3d508cc45bcbf015afb9f: 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f., storeName=e9b77e263bf3d508cc45bcbf015afb9f/family2, priority=12, startTime=1675965342342; duration=1sec 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b307c18a0ccccb0a839219d40f4730e1/family1 in testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:43,614 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp, totalSize=28.9 K 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 22c96a7058603f23c359a3e3eedaad85/family1 in testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:43,614 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,614 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp, totalSize=28.9 K 2023-02-09 17:55:43,614 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,614 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020907f8d0eb1f8c42a5a35647e4816fe337 2023-02-09 17:55:43,615 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:43,615 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317111 2023-02-09 17:55:43,615 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:43,615 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317112 2023-02-09 17:55:43,616 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:43,616 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:43,616 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209683bb274290d423cb5e3828d07f54f34 2023-02-09 17:55:43,617 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:43,617 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:43,618 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302096723baa9bf174ff8b910c9ab08c28990 2023-02-09 17:55:43,618 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020945018b85f1cb42c39ac07728c0b038fb 2023-02-09 17:55:43,618 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209a80554f2cfe24bf2a8444fef2c5cbdb8 2023-02-09 17:55:43,618 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:43,619 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:43,619 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302099e5f099444e54196a1d9748fd7738130 2023-02-09 17:55:43,619 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting e5a629c70ec84f198049bdc74cb26b85_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675965317111 2023-02-09 17:55:43,620 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 9e99b85205f3400cab9dc5300a65453e_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675965317112 2023-02-09 17:55:43,621 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302096a5d6c64c6de40e7906375c98b92654b 2023-02-09 17:55:43,622 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209b6499a5d893e48e3919fce24882ff1bc 2023-02-09 17:55:43,622 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:43,622 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 17:55:43,622 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209bab742d9e89a4088a15f400474445a25 2023-02-09 17:55:43,622 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:43,623 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209d66a654a77a445a6849cec7883a3013f 2023-02-09 17:55:43,623 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209c70a4e58cd6249ecbd3495ae9d4ba9cd 2023-02-09 17:55:43,623 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:43,623 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 17:55:43,624 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:43,624 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209f15d5df0444a47f486fdb480c323b243 2023-02-09 17:55:43,624 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 17:55:43,624 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 17:55:43,625 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 17:55:43,625 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 17:55:43,631 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:43,634 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:43,639 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:43,641 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:43,642 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] throttle.PressureAwareThroughputController(145): 22c96a7058603f23c359a3e3eedaad85#family1#compaction#115 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:43,648 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:43,649 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:43,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab] to archive 2023-02-09 17:55:43,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:43,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-56167784e38c47569287cc3236253857 2023-02-09 17:55:43,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-0996e25862e040949178d6e1525b6f00 2023-02-09 17:55:43,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-fe83d74956104583a8d64bf17f773be3 2023-02-09 17:55:43,660 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): b307c18a0ccccb0a839219d40f4730e1#family1#compaction#116 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:43,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family1/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-616f5eaa5f164a37a329be7d1e4c16ab 2023-02-09 17:55:43,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a] to archive 2023-02-09 17:55:43,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:43,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-3e1e36e3a2704001b5a4707a17859357 2023-02-09 17:55:43,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-ca752206a39245d0ab5771b5ba2661ba 2023-02-09 17:55:43,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-65a7f61091294ff2950f3c4036bf89eb 2023-02-09 17:55:43,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/family2/testCompactionWithHFileLink=e9b77e263bf3d508cc45bcbf015afb9f-aa8d7fb69275404482599cc1f7e3a21a 2023-02-09 17:55:43,703 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=281 (was 239) - Thread LEAK? -, OpenFileDescriptor=747 (was 601) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2952 (was 3094) 2023-02-09 17:55:43,718 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=279, OpenFileDescriptor=745, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=2952 2023-02-09 17:55:43,721 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,721 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-09 17:55:43,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-09 17:55:43,730 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,730 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 17:55:43,734 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 17:55:43,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-02-09 17:55:43,831 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,832 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 17:55:43,833 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,833 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 17:55:43,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-09 17:55:43,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:55:43,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-09 17:55:43,836 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,836 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,837 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:55:43,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:43,838 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:43,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3 empty. 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520 empty. 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3 empty. 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:43,839 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:43,839 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-09 17:55:43,937 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:43,937 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:43,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:44,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:44,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:44,246 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:44,247 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => b0fcebcd287c1ba929a1f12243ab2520, NAME => 'ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:44,248 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3a1038bc277a0f83bb0fe93be1831eb3, NAME => 'ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:44,248 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => a2a95d2d23d1e33829f11de663dbf7e3, NAME => 'ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:55:44,398 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:55:44,440 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:44,440 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:44,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:44,507 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family1/5edf7518cebc4deba32b59560ac249d9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/5edf7518cebc4deba32b59560ac249d9 2023-02-09 17:55:44,511 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b307c18a0ccccb0a839219d40f4730e1/family1 of b307c18a0ccccb0a839219d40f4730e1 into 5edf7518cebc4deba32b59560ac249d9(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:44,511 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:44,511 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675965343607; duration=0sec 2023-02-09 17:55:44,511 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 17:55:44,511 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 17:55:44,513 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 17:55:44,513 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1912): b307c18a0ccccb0a839219d40f4730e1/family2 is initiating minor compaction (all files) 2023-02-09 17:55:44,513 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b307c18a0ccccb0a839219d40f4730e1/family2 in testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:55:44,514 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp, totalSize=20.4 K 2023-02-09 17:55:44,514 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317112 2023-02-09 17:55:44,515 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:44,515 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:44,515 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:44,526 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): b307c18a0ccccb0a839219d40f4730e1#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:44,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_] to archive 2023-02-09 17:55:44,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:44,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-fa2727d9ae9f4ca1a05a5bf84429e13c 2023-02-09 17:55:44,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c1cc19d66fdb411aace4e33a90a1f0e3 2023-02-09 17:55:44,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c98057b116684d1589ccf10c77eaf3c4 2023-02-09 17:55:44,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-4992f4f9cf064904a9dc46cc307753ec 2023-02-09 17:55:44,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family1/9e99b85205f3400cab9dc5300a65453e_SeqId_34_ 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing b0fcebcd287c1ba929a1f12243ab2520, disabling compactions & flushes 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 3a1038bc277a0f83bb0fe93be1831eb3, disabling compactions & flushes 2023-02-09 17:55:44,653 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing a2a95d2d23d1e33829f11de663dbf7e3, disabling compactions & flushes 2023-02-09 17:55:44,653 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:44,653 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. after waiting 0 ms 2023-02-09 17:55:44,654 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. after waiting 0 ms 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,654 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 3a1038bc277a0f83bb0fe93be1831eb3: Waiting for close lock at 1675965344653Disabling compacts and flushes for region at 1675965344653Disabling writes for close at 1675965344654 (+1 ms)Writing region close event to WAL at 1675965344654Closed at 1675965344654 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. after waiting 0 ms 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,654 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,654 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for b0fcebcd287c1ba929a1f12243ab2520: Waiting for close lock at 1675965344653Disabling compacts and flushes for region at 1675965344653Disabling writes for close at 1675965344654 (+1 ms)Writing region close event to WAL at 1675965344654Closed at 1675965344654 2023-02-09 17:55:44,654 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for a2a95d2d23d1e33829f11de663dbf7e3: Waiting for close lock at 1675965344653Disabling compacts and flushes for region at 1675965344653Disabling writes for close at 1675965344654 (+1 ms)Writing region close event to WAL at 1675965344654Closed at 1675965344654 2023-02-09 17:55:44,656 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:55:44,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965344657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965344657"}]},"ts":"1675965344657"} 2023-02-09 17:55:44,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965344657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965344657"}]},"ts":"1675965344657"} 2023-02-09 17:55:44,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675965344657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965344657"}]},"ts":"1675965344657"} 2023-02-09 17:55:44,658 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 17:55:44,659 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:55:44,659 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965344659"}]},"ts":"1675965344659"} 2023-02-09 17:55:44,660 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-09 17:55:44,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3a1038bc277a0f83bb0fe93be1831eb3, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a2a95d2d23d1e33829f11de663dbf7e3, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b0fcebcd287c1ba929a1f12243ab2520, ASSIGN}] 2023-02-09 17:55:44,664 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a2a95d2d23d1e33829f11de663dbf7e3, ASSIGN 2023-02-09 17:55:44,664 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3a1038bc277a0f83bb0fe93be1831eb3, ASSIGN 2023-02-09 17:55:44,664 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b0fcebcd287c1ba929a1f12243ab2520, ASSIGN 2023-02-09 17:55:44,665 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3a1038bc277a0f83bb0fe93be1831eb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:44,665 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b0fcebcd287c1ba929a1f12243ab2520, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:44,665 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a2a95d2d23d1e33829f11de663dbf7e3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:55:44,817 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3a1038bc277a0f83bb0fe93be1831eb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:44,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a2a95d2d23d1e33829f11de663dbf7e3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:44,817 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=b0fcebcd287c1ba929a1f12243ab2520, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:44,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965344817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965344817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965344817"}]},"ts":"1675965344817"} 2023-02-09 17:55:44,818 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965344817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965344817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965344817"}]},"ts":"1675965344817"} 2023-02-09 17:55:44,818 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675965344817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965344817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965344817"}]},"ts":"1675965344817"} 2023-02-09 17:55:44,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 3a1038bc277a0f83bb0fe93be1831eb3, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:44,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure b0fcebcd287c1ba929a1f12243ab2520, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:44,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure a2a95d2d23d1e33829f11de663dbf7e3, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:55:44,891 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family1/1443faa19de743438b57bdc522e113bb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/1443faa19de743438b57bdc522e113bb 2023-02-09 17:55:44,895 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 22c96a7058603f23c359a3e3eedaad85/family1 of 22c96a7058603f23c359a3e3eedaad85 into 1443faa19de743438b57bdc522e113bb(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:44,895 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:44,895 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675965343611; duration=1sec 2023-02-09 17:55:44,895 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 17:55:44,895 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 17:55:44,897 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 17:55:44,897 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1912): 22c96a7058603f23c359a3e3eedaad85/family2 is initiating minor compaction (all files) 2023-02-09 17:55:44,897 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 22c96a7058603f23c359a3e3eedaad85/family2 in testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:55:44,897 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp, totalSize=20.4 K 2023-02-09 17:55:44,898 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965317111 2023-02-09 17:55:44,898 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965318902 2023-02-09 17:55:44,899 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965320690 2023-02-09 17:55:44,899 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965322477 2023-02-09 17:55:44,910 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] throttle.PressureAwareThroughputController(145): 22c96a7058603f23c359a3e3eedaad85#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:44,941 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:44,941 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:44,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:44,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_] to archive 2023-02-09 17:55:44,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:44,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-600b66ef93ea4c7abf08e47ad14ac910 2023-02-09 17:55:44,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-0cc3a7a911014a97b2da5423457ef7fe 2023-02-09 17:55:44,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-5ec2bbfee7cf4af99569d762f0895d07 2023-02-09 17:55:44,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-17b19f0e9082469a81fd799d144556e5 2023-02-09 17:55:44,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family1/e5a629c70ec84f198049bdc74cb26b85_SeqId_34_ 2023-02-09 17:55:44,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a2a95d2d23d1e33829f11de663dbf7e3, NAME => 'ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 17:55:44,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,974 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,975 DEBUG [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1 2023-02-09 17:55:44,975 DEBUG [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1 2023-02-09 17:55:44,975 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a95d2d23d1e33829f11de663dbf7e3 columnFamilyName family1 2023-02-09 17:55:44,976 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] regionserver.HStore(310): Store=a2a95d2d23d1e33829f11de663dbf7e3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:44,976 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,977 DEBUG [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2 2023-02-09 17:55:44,977 DEBUG [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2 2023-02-09 17:55:44,977 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2a95d2d23d1e33829f11de663dbf7e3 columnFamilyName family2 2023-02-09 17:55:44,978 INFO [StoreOpener-a2a95d2d23d1e33829f11de663dbf7e3-1] regionserver.HStore(310): Store=a2a95d2d23d1e33829f11de663dbf7e3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:44,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:44,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:55:44,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:44,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a2a95d2d23d1e33829f11de663dbf7e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67282529, jitterRate=0.0025878101587295532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:44,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a2a95d2d23d1e33829f11de663dbf7e3: Running coprocessor pre-open hook at 1675965344973Writing region info on filesystem at 1675965344973Initializing all the Stores at 1675965344973Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344973Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344973Cleaning up temporary data from old regions at 1675965344979 (+6 ms)Cleaning up detritus from prior splits at 1675965344980 (+1 ms)Running coprocessor post-open hooks at 1675965344983 (+3 ms)Region opened successfully at 1675965344983 2023-02-09 17:55:44,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3., pid=111, masterSystemTime=1675965344970 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:44,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b0fcebcd287c1ba929a1f12243ab2520, NAME => 'ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 17:55:44,985 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a2a95d2d23d1e33829f11de663dbf7e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,985 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675965344985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965344985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965344985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965344985"}]},"ts":"1675965344985"} 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,986 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,987 DEBUG [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1 2023-02-09 17:55:44,987 DEBUG [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1 2023-02-09 17:55:44,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-09 17:55:44,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure a2a95d2d23d1e33829f11de663dbf7e3, server=jenkins-hbase4.apache.org,42581,1675965218218 in 166 msec 2023-02-09 17:55:44,988 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0fcebcd287c1ba929a1f12243ab2520 columnFamilyName family1 2023-02-09 17:55:44,988 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] regionserver.HStore(310): Store=b0fcebcd287c1ba929a1f12243ab2520/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:44,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a2a95d2d23d1e33829f11de663dbf7e3, ASSIGN in 325 msec 2023-02-09 17:55:44,989 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,990 DEBUG [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2 2023-02-09 17:55:44,990 DEBUG [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2 2023-02-09 17:55:44,990 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0fcebcd287c1ba929a1f12243ab2520 columnFamilyName family2 2023-02-09 17:55:44,991 INFO [StoreOpener-b0fcebcd287c1ba929a1f12243ab2520-1] regionserver.HStore(310): Store=b0fcebcd287c1ba929a1f12243ab2520/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:44,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:44,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:55:44,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:44,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b0fcebcd287c1ba929a1f12243ab2520; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59354816, jitterRate=-0.11554431915283203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:44,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b0fcebcd287c1ba929a1f12243ab2520: Running coprocessor pre-open hook at 1675965344985Writing region info on filesystem at 1675965344985Initializing all the Stores at 1675965344986 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344986Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344986Cleaning up temporary data from old regions at 1675965344992 (+6 ms)Cleaning up detritus from prior splits at 1675965344992Running coprocessor post-open hooks at 1675965344995 (+3 ms)Region opened successfully at 1675965344995 2023-02-09 17:55:44,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520., pid=110, masterSystemTime=1675965344970 2023-02-09 17:55:44,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:44,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:44,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a1038bc277a0f83bb0fe93be1831eb3, NAME => 'ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 17:55:44,997 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=b0fcebcd287c1ba929a1f12243ab2520, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:44,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:55:44,998 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965344997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965344997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965344997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965344997"}]},"ts":"1675965344997"} 2023-02-09 17:55:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:44,999 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:45,000 DEBUG [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1 2023-02-09 17:55:45,000 DEBUG [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1 2023-02-09 17:55:45,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-02-09 17:55:45,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure b0fcebcd287c1ba929a1f12243ab2520, server=jenkins-hbase4.apache.org,42581,1675965218218 in 180 msec 2023-02-09 17:55:45,000 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1038bc277a0f83bb0fe93be1831eb3 columnFamilyName family1 2023-02-09 17:55:45,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=b0fcebcd287c1ba929a1f12243ab2520, ASSIGN in 337 msec 2023-02-09 17:55:45,001 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] regionserver.HStore(310): Store=3a1038bc277a0f83bb0fe93be1831eb3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:45,001 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:45,002 DEBUG [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2 2023-02-09 17:55:45,002 DEBUG [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2 2023-02-09 17:55:45,003 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1038bc277a0f83bb0fe93be1831eb3 columnFamilyName family2 2023-02-09 17:55:45,003 INFO [StoreOpener-3a1038bc277a0f83bb0fe93be1831eb3-1] regionserver.HStore(310): Store=3a1038bc277a0f83bb0fe93be1831eb3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:55:45,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:45,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:45,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:55:45,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:55:45,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:55:45,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3a1038bc277a0f83bb0fe93be1831eb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74117757, jitterRate=0.10444064438343048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:55:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3a1038bc277a0f83bb0fe93be1831eb3: Running coprocessor pre-open hook at 1675965344998Writing region info on filesystem at 1675965344998Initializing all the Stores at 1675965344998Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344998Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965344999 (+1 ms)Cleaning up temporary data from old regions at 1675965345005 (+6 ms)Cleaning up detritus from prior splits at 1675965345005Running coprocessor post-open hooks at 1675965345008 (+3 ms)Region opened successfully at 1675965345008 2023-02-09 17:55:45,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3., pid=109, masterSystemTime=1675965344970 2023-02-09 17:55:45,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:45,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:45,010 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3a1038bc277a0f83bb0fe93be1831eb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:45,010 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675965345010"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965345010"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965345010"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965345010"}]},"ts":"1675965345010"} 2023-02-09 17:55:45,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-02-09 17:55:45,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 3a1038bc277a0f83bb0fe93be1831eb3, server=jenkins-hbase4.apache.org,42581,1675965218218 in 192 msec 2023-02-09 17:55:45,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-09 17:55:45,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3a1038bc277a0f83bb0fe93be1831eb3, ASSIGN in 349 msec 2023-02-09 17:55:45,014 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:55:45,014 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965345014"}]},"ts":"1675965345014"} 2023-02-09 17:55:45,015 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-09 17:55:45,018 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:55:45,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1840 sec 2023-02-09 17:55:45,729 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/.tmp/family2/bf2b0a1658764e23bc97f4c103ac4d92 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/bf2b0a1658764e23bc97f4c103ac4d92 2023-02-09 17:55:45,734 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 22c96a7058603f23c359a3e3eedaad85/family2 of 22c96a7058603f23c359a3e3eedaad85 into bf2b0a1658764e23bc97f4c103ac4d92(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:45,734 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 22c96a7058603f23c359a3e3eedaad85: 2023-02-09 17:55:45,734 INFO [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85., storeName=22c96a7058603f23c359a3e3eedaad85/family2, priority=12, startTime=1675965342473; duration=0sec 2023-02-09 17:55:45,734 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 17:55:45,734 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. because compaction request was cancelled 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 17:55:45,735 DEBUG [RS:0;jenkins-hbase4:42581-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. because compaction request was cancelled 2023-02-09 17:55:45,742 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/.tmp/family2/fb4f29de286d42d9b0bb550a591e2ec6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/fb4f29de286d42d9b0bb550a591e2ec6 2023-02-09 17:55:45,744 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-09 17:55:45,746 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b307c18a0ccccb0a839219d40f4730e1/family2 of b307c18a0ccccb0a839219d40f4730e1 into fb4f29de286d42d9b0bb550a591e2ec6(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:45,746 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b307c18a0ccccb0a839219d40f4730e1: 2023-02-09 17:55:45,746 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1., storeName=b307c18a0ccccb0a839219d40f4730e1/family2, priority=12, startTime=1675965342415; duration=1sec 2023-02-09 17:55:45,746 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:55:45,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27] to archive 2023-02-09 17:55:45,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:45,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-e65e6d0f5ed94f04bfaa732f387eb82e 2023-02-09 17:55:45,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-dba7c99a9eae45b880fa4c817f88ccc8 2023-02-09 17:55:45,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-d3037e58cd9a4bdd83cb6a499868a74c 2023-02-09 17:55:45,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/family2/testCompactionWithHFileLink=22c96a7058603f23c359a3e3eedaad85-a292c83e89e142b9b8f45139dfc54f27 2023-02-09 17:55:45,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942] to archive 2023-02-09 17:55:45,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:45,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-05d6f8f37ca5436b9a8c876baf2dbf3f 2023-02-09 17:55:45,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-d806cec788764cc3a7701ca0938b3ee9 2023-02-09 17:55:45,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-afd8f71a02654ed29ea0f4732c710b5b 2023-02-09 17:55:45,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/family2/testCompactionWithHFileLink=b307c18a0ccccb0a839219d40f4730e1-c7c94924c13447b1958a2b95126cc942 2023-02-09 17:55:45,942 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:45,943 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 17:55:45,943 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-09 17:55:45,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:45,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:45,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:45,951 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:45,951 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:45,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:45,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 17:55:45,953 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 17:55:45,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:45,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 17:55:45,953 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 17:55:45,954 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:45,954 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:45,956 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:45,956 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:45,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:45,957 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:45,957 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:45,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 17:55:45,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 17:55:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 17:55:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 17:55:45,958 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:45,958 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. started... 2023-02-09 17:55:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:45,960 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:45,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:45,960 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b0fcebcd287c1ba929a1f12243ab2520 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:45,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:45,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. started... 2023-02-09 17:55:45,960 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. started... 2023-02-09 17:55:45,960 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a1038bc277a0f83bb0fe93be1831eb3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:45,960 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2a95d2d23d1e33829f11de663dbf7e3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:55:46,377 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209111e485d8f4c46cb93c05a33ebbeb45f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209111e485d8f4c46cb93c05a33ebbeb45f 2023-02-09 17:55:46,377 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209bf5c2da8357b4d91b5a8b5bd544268af to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209bf5c2da8357b4d91b5a8b5bd544268af 2023-02-09 17:55:46,377 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a4ab55d568904e5fafd2b6ddef3358fd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209a4ab55d568904e5fafd2b6ddef3358fd 2023-02-09 17:55:46,782 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/61a74a566d7d44f3a7853045b23a720a 2023-02-09 17:55:46,782 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/c351398041f3416ea0fd99f9d3dacc35 2023-02-09 17:55:46,783 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/63095ec4527649beac67ac9de737ff4d 2023-02-09 17:55:47,198 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020909f04da23de54dc78e8ce8715ce23cfc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020909f04da23de54dc78e8ce8715ce23cfc 2023-02-09 17:55:47,198 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302099c697cf6f20c42d8815138ba6d32531c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302099c697cf6f20c42d8815138ba6d32531c 2023-02-09 17:55:47,198 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302099a9f2c78de684a7cb9affb9a75839635 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302099a9f2c78de684a7cb9affb9a75839635 2023-02-09 17:55:47,203 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/759fe449adab495686c8bac52f998446 2023-02-09 17:55:47,207 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/63095ec4527649beac67ac9de737ff4d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d 2023-02-09 17:55:47,210 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:47,211 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/759fe449adab495686c8bac52f998446 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446 2023-02-09 17:55:47,213 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:47,214 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b0fcebcd287c1ba929a1f12243ab2520 in 1254ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:47,215 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:47,215 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:47,215 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:47,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/b398c29c46c546da9a7fddb555220d85 2023-02-09 17:55:47,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/6a2d0536802c47ebb7ce0751f009aac1 2023-02-09 17:55:47,609 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/c351398041f3416ea0fd99f9d3dacc35 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35 2023-02-09 17:55:47,609 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/61a74a566d7d44f3a7853045b23a720a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a 2023-02-09 17:55:47,613 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:47,613 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 17:55:47,613 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/b398c29c46c546da9a7fddb555220d85 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85 2023-02-09 17:55:47,613 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/6a2d0536802c47ebb7ce0751f009aac1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1 2023-02-09 17:55:47,617 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:47,617 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:55:47,617 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3a1038bc277a0f83bb0fe93be1831eb3 in 1657ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:47,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:47,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:47,618 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a2a95d2d23d1e33829f11de663dbf7e3 in 1658ms, sequenceid=5, compaction requested=false 2023-02-09 17:55:47,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:47,618 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 17:55:47,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 17:55:47,620 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:47,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:47,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 17:55:47,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1932fcfb[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:47,622 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 17:55:47,622 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,624 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,624 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 17:55:47,624 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 17:55:47,624 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:47,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:47,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 17:55:47,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:47,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 17:55:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:47,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 17:55:47,628 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 17:55:47,629 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:47,629 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:47,629 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 17:55:47,629 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:47,631 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,631 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:47,631 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:47,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:47,632 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,633 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:47,635 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:47,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:47,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:47,636 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 17:55:47,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:47,636 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 17:55:47,637 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:47,637 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:47,737 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:47,737 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:47,737 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:47,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:47,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:47,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:47,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:47,741 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:47,741 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:47,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:47,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:47,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 17:55:47,743 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 17:55:47,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:47,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 17:55:47,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 17:55:47,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:47,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,745 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:47,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:47,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:47,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:47,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:47,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:47,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:47,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 17:55:47,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 17:55:47,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 17:55:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 17:55:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 17:55:47,746 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:47,746 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. started... 2023-02-09 17:55:47,746 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:47,746 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:47,746 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:47,747 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b0fcebcd287c1ba929a1f12243ab2520 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:47,747 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. started... 2023-02-09 17:55:47,747 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. started... 2023-02-09 17:55:47,747 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2a95d2d23d1e33829f11de663dbf7e3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:47,747 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a1038bc277a0f83bb0fe93be1831eb3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:55:48,165 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302097ee707b2f5b24f6cbe21278a1cc0a6d0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302097ee707b2f5b24f6cbe21278a1cc0a6d0 2023-02-09 17:55:48,165 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209216c7187c9ab4420b88e0f89c738a8b0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209216c7187c9ab4420b88e0f89c738a8b0 2023-02-09 17:55:48,168 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209bb68ded8ff8849148e63ad1f9ce08192 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209bb68ded8ff8849148e63ad1f9ce08192 2023-02-09 17:55:48,170 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/0ea9b2e13d5341c2a59723452f80ce75 2023-02-09 17:55:48,171 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/fe257ee514c14786be36a6eced30bd31 2023-02-09 17:55:48,573 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/001c44898a004e3a8d5d6c5ed9ed8f43 2023-02-09 17:55:48,584 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209fdfbf27352464943b6698dbf5cc21dde to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230209fdfbf27352464943b6698dbf5cc21dde 2023-02-09 17:55:48,584 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209a4882cbcebca481d8dca78373fe81a8c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209a4882cbcebca481d8dca78373fe81a8c 2023-02-09 17:55:48,586 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302098ac8552f24df40f8934a0006a0bfe5f0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302098ac8552f24df40f8934a0006a0bfe5f0 2023-02-09 17:55:48,591 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/f29ca2ba88514cf7b60346c519172207 2023-02-09 17:55:48,592 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/846ef32c4b5c4427a0fde392eca78771 2023-02-09 17:55:48,593 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/8ff3407282054bc882b6d661b5aad790 2023-02-09 17:55:48,595 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/0ea9b2e13d5341c2a59723452f80ce75 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75 2023-02-09 17:55:48,596 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/fe257ee514c14786be36a6eced30bd31 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31 2023-02-09 17:55:48,598 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/001c44898a004e3a8d5d6c5ed9ed8f43 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43 2023-02-09 17:55:48,600 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:48,601 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/f29ca2ba88514cf7b60346c519172207 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207 2023-02-09 17:55:48,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:48,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 17:55:48,604 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/8ff3407282054bc882b6d661b5aad790 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790 2023-02-09 17:55:48,605 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/846ef32c4b5c4427a0fde392eca78771 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771 2023-02-09 17:55:48,606 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:48,607 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3a1038bc277a0f83bb0fe93be1831eb3 in 860ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:48,607 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:48,607 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:48,607 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:48,615 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:48,615 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:55:48,615 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b0fcebcd287c1ba929a1f12243ab2520 in 868ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:48,615 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a2a95d2d23d1e33829f11de663dbf7e3 in 868ms, sequenceid=9, compaction requested=false 2023-02-09 17:55:48,615 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:48,616 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:48,616 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:48,616 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 17:55:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 17:55:48,617 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,617 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,618 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 17:55:48,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@705aab02[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:48,619 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 17:55:48,619 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,620 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 17:55:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 17:55:48,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:48,620 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,620 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 17:55:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:48,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 17:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:48,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 17:55:48,628 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 17:55:48,628 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:48,628 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:48,628 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 17:55:48,628 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:48,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:48,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:48,630 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,631 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:48,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:48,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 17:55:48,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:48,633 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:48,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,633 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:48,734 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:48,734 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:48,734 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:48,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:48,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:48,740 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:48,740 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:48,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 17:55:48,743 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 17:55:48,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:48,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 17:55:48,743 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 17:55:48,744 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,744 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:48,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,745 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:48,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:48,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:48,745 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:48,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:48,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 17:55:48,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 17:55:48,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 17:55:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 17:55:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 17:55:48,753 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:48,753 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. started... 2023-02-09 17:55:48,753 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2a95d2d23d1e33829f11de663dbf7e3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:48,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:48,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:48,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:48,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. started... 2023-02-09 17:55:48,756 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b0fcebcd287c1ba929a1f12243ab2520 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:48,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:48,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. started... 2023-02-09 17:55:48,757 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a1038bc277a0f83bb0fe93be1831eb3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:55:48,785 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020921e6ae49a56f478990a1202d2a046c60 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020921e6ae49a56f478990a1202d2a046c60 2023-02-09 17:55:48,789 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209cb11381fa32949bf88549523fa8d702a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209cb11381fa32949bf88549523fa8d702a 2023-02-09 17:55:48,791 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/6f2bda815e3e4334802b8ba01260a8ea 2023-02-09 17:55:48,806 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/bb00a11e60114e649e551cbde6f00aba 2023-02-09 17:55:48,828 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302092e5b2c3d69e8450eb4aa10ce8844cc83 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302092e5b2c3d69e8450eb4aa10ce8844cc83 2023-02-09 17:55:49,186 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209932c2fc1e1534ea4aed398f5d86e207f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209932c2fc1e1534ea4aed398f5d86e207f 2023-02-09 17:55:49,235 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209131e3c13c4864dfda4e6d67a50aa8a84 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230209131e3c13c4864dfda4e6d67a50aa8a84 2023-02-09 17:55:49,249 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/0b5f2a0ea9a845799ff7d89c6e6c650e 2023-02-09 17:55:49,254 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/6f2bda815e3e4334802b8ba01260a8ea as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea 2023-02-09 17:55:49,258 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:49,259 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/0b5f2a0ea9a845799ff7d89c6e6c650e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e 2023-02-09 17:55:49,263 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:49,264 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a2a95d2d23d1e33829f11de663dbf7e3 in 511ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:49,264 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:49,264 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:49,264 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:49,591 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/94cd5dbaebac4cdcb5674e50aa8eb254 2023-02-09 17:55:49,641 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/582ed9a06e28454db71dae079dd92dca 2023-02-09 17:55:49,644 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/bb00a11e60114e649e551cbde6f00aba as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba 2023-02-09 17:55:49,647 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:49,648 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/582ed9a06e28454db71dae079dd92dca as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca 2023-02-09 17:55:49,651 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:49,652 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b0fcebcd287c1ba929a1f12243ab2520 in 896ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:49,652 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:49,652 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:49,652 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:50,005 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302093396709c21334fb09d06cd81793acbe1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302093396709c21334fb09d06cd81793acbe1 2023-02-09 17:55:50,410 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/b27f9209ba0c48b0930bdf7d7beff25b 2023-02-09 17:55:50,413 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/94cd5dbaebac4cdcb5674e50aa8eb254 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254 2023-02-09 17:55:50,416 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 17:55:50,417 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/b27f9209ba0c48b0930bdf7d7beff25b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b 2023-02-09 17:55:50,420 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:55:50,420 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3a1038bc277a0f83bb0fe93be1831eb3 in 1663ms, sequenceid=13, compaction requested=true 2023-02-09 17:55:50,421 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:50,421 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 17:55:50,421 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 17:55:50,422 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,422 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:50,423 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,423 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:50,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:50,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 17:55:50,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@994551e[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:50,424 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 17:55:50,424 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,430 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 17:55:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 17:55:50,430 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:50,430 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,431 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:50,432 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 17:55:50,432 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,432 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:50,432 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 17:55:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:50,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:50,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 17:55:50,434 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 17:55:50,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:50,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:50,434 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 17:55:50,434 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:50,435 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,435 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:50,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:50,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,435 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:50,436 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,437 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,438 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:50,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:50,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 17:55:50,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:50,439 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,439 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:50,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:50,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:50,474 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:55:50,539 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:50,539 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:50,539 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:50,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:50,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:50,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:50,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:55:50,543 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:50,543 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:50,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:50,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:50,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 17:55:50,545 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 17:55:50,545 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:50,545 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 17:55:50,545 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 17:55:50,546 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,546 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:50,548 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:50,548 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:50,548 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:50,549 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:50,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:50,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 17:55:50,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 17:55:50,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 17:55:50,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 17:55:50,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:50,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 17:55:50,550 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:50,550 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. started... 2023-02-09 17:55:50,550 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:50,550 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. started... 2023-02-09 17:55:50,550 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b0fcebcd287c1ba929a1f12243ab2520 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:50,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:50,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:50,550 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2a95d2d23d1e33829f11de663dbf7e3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:50,550 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:50,551 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. started... 2023-02-09 17:55:50,551 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a1038bc277a0f83bb0fe93be1831eb3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:55:50,581 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302093e1f9d49c45f44ba928f669ba99028db to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302093e1f9d49c45f44ba928f669ba99028db 2023-02-09 17:55:50,977 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302099569ef86010448518fb36fb02af3324e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302099569ef86010448518fb36fb02af3324e 2023-02-09 17:55:50,980 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302099f56c8fbe0764d49be95bed578d3c0c1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302099f56c8fbe0764d49be95bed578d3c0c1 2023-02-09 17:55:50,981 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/4882df4a987a48109a7a23002ae9ebb1 2023-02-09 17:55:50,985 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/ea5d2d3314f54cdbab02f99679dd4276 2023-02-09 17:55:50,989 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/18d55acdbe4f4bb8a67fd253d2b5415f 2023-02-09 17:55:50,994 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097ae9a417eacd49e3a50d665df9e581ca to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302097ae9a417eacd49e3a50d665df9e581ca 2023-02-09 17:55:50,996 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302093ddd899b60df468fb3e4f86f5338c64d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302093ddd899b60df468fb3e4f86f5338c64d 2023-02-09 17:55:51,399 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/1cb7fd9e30984f8c99face9a0dc635ad 2023-02-09 17:55:51,401 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/828d499881be4e0ba90d69b661591c7a 2023-02-09 17:55:51,402 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020933f6e6607906469bacc45739a60eccbf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020933f6e6607906469bacc45739a60eccbf 2023-02-09 17:55:51,403 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/4882df4a987a48109a7a23002ae9ebb1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1 2023-02-09 17:55:51,404 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/ea5d2d3314f54cdbab02f99679dd4276 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276 2023-02-09 17:55:51,408 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:51,408 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:51,409 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/1cb7fd9e30984f8c99face9a0dc635ad as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad 2023-02-09 17:55:51,409 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/828d499881be4e0ba90d69b661591c7a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a 2023-02-09 17:55:51,413 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:51,414 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:51,414 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b0fcebcd287c1ba929a1f12243ab2520 in 864ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:51,414 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:51,414 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:51,414 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:51,414 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3a1038bc277a0f83bb0fe93be1831eb3 in 863ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:51,414 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:51,415 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:51,808 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/ebefb3ce53024586b36cbc8749bf8505 2023-02-09 17:55:51,814 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/18d55acdbe4f4bb8a67fd253d2b5415f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f 2023-02-09 17:55:51,820 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 17:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/ebefb3ce53024586b36cbc8749bf8505 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505 2023-02-09 17:55:51,830 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:55:51,831 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a2a95d2d23d1e33829f11de663dbf7e3 in 1281ms, sequenceid=17, compaction requested=true 2023-02-09 17:55:51,831 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:51,831 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 17:55:51,831 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 17:55:51,833 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,833 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:51,834 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,834 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:51,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:51,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 17:55:51,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4690427[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:51,835 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 17:55:51,835 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,836 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,837 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 17:55:51,837 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 17:55:51,837 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,837 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:51,837 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:51,838 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 17:55:51,838 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,838 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:51,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:51,838 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 17:55:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:51,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 17:55:51,840 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 17:55:51,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:51,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:51,841 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 17:55:51,841 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:51,842 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:51,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,843 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:51,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:51,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:51,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,844 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:51,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,847 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:51,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:51,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:51,859 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:51,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:51,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:51,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 17:55:51,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:51,859 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:51,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:51,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:51,860 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:51,960 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:51,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:51,960 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:51,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:51,972 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:51,982 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:51,989 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:51,990 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:52,014 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:52,014 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:52,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:55:52,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 17:55:52,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 17:55:52,016 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 17:55:52,016 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:52,016 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 17:55:52,016 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 17:55:52,017 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:52,017 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:52,018 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:52,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:52,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:52,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:52,018 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:55:52,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:52,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:55:52,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:52,019 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 17:55:52,019 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 17:55:52,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 17:55:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 17:55:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:55:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. started... 2023-02-09 17:55:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:55:52,019 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:52,019 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b0fcebcd287c1ba929a1f12243ab2520 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. started... 2023-02-09 17:55:52,019 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. started... 2023-02-09 17:55:52,020 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2a95d2d23d1e33829f11de663dbf7e3 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:52,020 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3a1038bc277a0f83bb0fe93be1831eb3 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:55:52,837 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/4c50a10e5d274d1984092b00ff9d3361 2023-02-09 17:55:52,837 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/9f937f8b9996488b8bc2033b0f04b347 2023-02-09 17:55:52,837 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/7ce4201dd30f40fcbd047d06f86d7b04 2023-02-09 17:55:52,841 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ce4201dd30f40fcbd047d06f86d7b04 2023-02-09 17:55:52,841 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c50a10e5d274d1984092b00ff9d3361 2023-02-09 17:55:52,841 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f937f8b9996488b8bc2033b0f04b347 2023-02-09 17:55:53,657 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/8729cb7951324f29822ccb9ef60ed4ab 2023-02-09 17:55:53,661 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8729cb7951324f29822ccb9ef60ed4ab 2023-02-09 17:55:53,662 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/4c50a10e5d274d1984092b00ff9d3361 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361 2023-02-09 17:55:53,662 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/940462f8e28747c68589a33de67494ab 2023-02-09 17:55:53,663 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f 2023-02-09 17:55:53,666 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 940462f8e28747c68589a33de67494ab 2023-02-09 17:55:53,666 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c50a10e5d274d1984092b00ff9d3361 2023-02-09 17:55:53,667 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,667 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec7fc39d2dfc40d5bd0391ef7d4a005f 2023-02-09 17:55:53,667 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/9f937f8b9996488b8bc2033b0f04b347 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347 2023-02-09 17:55:53,667 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/8729cb7951324f29822ccb9ef60ed4ab as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab 2023-02-09 17:55:53,667 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/7ce4201dd30f40fcbd047d06f86d7b04 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04 2023-02-09 17:55:53,671 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f937f8b9996488b8bc2033b0f04b347 2023-02-09 17:55:53,671 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,671 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ce4201dd30f40fcbd047d06f86d7b04 2023-02-09 17:55:53,671 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,672 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/940462f8e28747c68589a33de67494ab as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab 2023-02-09 17:55:53,672 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f 2023-02-09 17:55:53,675 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8729cb7951324f29822ccb9ef60ed4ab 2023-02-09 17:55:53,675 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,676 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 940462f8e28747c68589a33de67494ab 2023-02-09 17:55:53,676 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,676 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a2a95d2d23d1e33829f11de663dbf7e3 in 1656ms, sequenceid=23, compaction requested=true 2023-02-09 17:55:53,677 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec7fc39d2dfc40d5bd0391ef7d4a005f 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:53,677 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:55:53,677 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b0fcebcd287c1ba929a1f12243ab2520 in 1658ms, sequenceid=23, compaction requested=true 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:55:53,677 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3a1038bc277a0f83bb0fe93be1831eb3 in 1657ms, sequenceid=23, compaction requested=true 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:53,677 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:55:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:55:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 17:55:53,678 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 17:55:53,679 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,679 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:53,679 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,679 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:55:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:53,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 17:55:53,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ab2f575[Count = 0] remaining members to acquire global barrier 2023-02-09 17:55:53,681 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 17:55:53,681 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,684 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,684 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 17:55:53,684 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 17:55:53,684 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,684 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:55:53,684 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:55:53,689 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 17:55:53,689 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:53,689 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,690 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 17:55:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:55:53,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 17:55:53,692 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 17:55:53,692 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:55:53,692 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:55:53,692 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 17:55:53,692 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:55:53,694 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:55:53,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:55:53,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:55:53,694 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:55:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 17:55:53,698 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 17:55:53,700 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:55:53,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:55:53,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 17:55:53,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:55:53,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 17:55:53,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 17:55:53,700 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:55:53,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:55:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:55:53,801 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:55:53,801 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:53,801 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:55:53,802 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:53,802 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): b0fcebcd287c1ba929a1f12243ab2520/family1 is initiating major compaction (all files) 2023-02-09 17:55:53,802 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:53,802 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:53,802 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of b0fcebcd287c1ba929a1f12243ab2520/family1 in ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:53,802 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp, totalSize=26.6 K 2023-02-09 17:55:53,803 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 63095ec4527649beac67ac9de737ff4d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345950 2023-02-09 17:55:53,803 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 001c44898a004e3a8d5d6c5ed9ed8f43, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:53,804 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting bb00a11e60114e649e551cbde6f00aba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348737 2023-02-09 17:55:53,804 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 4882df4a987a48109a7a23002ae9ebb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:53,805 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 9f937f8b9996488b8bc2033b0f04b347, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:53,815 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): b0fcebcd287c1ba929a1f12243ab2520#family1#compaction#149 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:54,230 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302093fea43e07c014b52ba23877fcb4a52c6_del 2023-02-09 17:55:54,230 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093fea43e07c014b52ba23877fcb4a52c6_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302093fea43e07c014b52ba23877fcb4a52c6_del 2023-02-09 17:55:55,043 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 021b7b812c6443c3be75ae2e8805a1e9 2023-02-09 17:55:55,044 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family1/021b7b812c6443c3be75ae2e8805a1e9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/021b7b812c6443c3be75ae2e8805a1e9 2023-02-09 17:55:55,047 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 021b7b812c6443c3be75ae2e8805a1e9 2023-02-09 17:55:55,048 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b0fcebcd287c1ba929a1f12243ab2520/family1 of b0fcebcd287c1ba929a1f12243ab2520 into 021b7b812c6443c3be75ae2e8805a1e9(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:55,048 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:55,048 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:55,048 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): b0fcebcd287c1ba929a1f12243ab2520/family2 is initiating major compaction (all files) 2023-02-09 17:55:55,048 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:55,048 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:55,049 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of b0fcebcd287c1ba929a1f12243ab2520/family2 in ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:55:55,049 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp, totalSize=25.3 K 2023-02-09 17:55:55,049 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 759fe449adab495686c8bac52f998446, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345950 2023-02-09 17:55:55,050 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8ff3407282054bc882b6d661b5aad790, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:55,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347] to archive 2023-02-09 17:55:55,050 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 582ed9a06e28454db71dae079dd92dca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348737 2023-02-09 17:55:55,050 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 1cb7fd9e30984f8c99face9a0dc635ad, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:55,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:55,051 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 940462f8e28747c68589a33de67494ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:55,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/63095ec4527649beac67ac9de737ff4d 2023-02-09 17:55:55,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/001c44898a004e3a8d5d6c5ed9ed8f43 2023-02-09 17:55:55,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/bb00a11e60114e649e551cbde6f00aba 2023-02-09 17:55:55,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/4882df4a987a48109a7a23002ae9ebb1 2023-02-09 17:55:55,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/9f937f8b9996488b8bc2033b0f04b347 2023-02-09 17:55:55,061 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): b0fcebcd287c1ba929a1f12243ab2520#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:55,474 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302094e09e233b29f47ba989eeb96aeb8cc0c_del 2023-02-09 17:55:55,474 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094e09e233b29f47ba989eeb96aeb8cc0c_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302094e09e233b29f47ba989eeb96aeb8cc0c_del 2023-02-09 17:55:56,288 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 615e066236614cafb6e26e148656f977 2023-02-09 17:55:56,288 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/.tmp/family2/615e066236614cafb6e26e148656f977 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/615e066236614cafb6e26e148656f977 2023-02-09 17:55:56,292 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 615e066236614cafb6e26e148656f977 2023-02-09 17:55:56,292 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b0fcebcd287c1ba929a1f12243ab2520/family2 of b0fcebcd287c1ba929a1f12243ab2520 into 615e066236614cafb6e26e148656f977(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:55:56,293 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:56,293 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:56,293 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): a2a95d2d23d1e33829f11de663dbf7e3/family1 is initiating major compaction (all files) 2023-02-09 17:55:56,293 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:56,293 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:56,293 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of a2a95d2d23d1e33829f11de663dbf7e3/family1 in ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:56,293 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp, totalSize=26.6 K 2023-02-09 17:55:56,294 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 61a74a566d7d44f3a7853045b23a720a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345950 2023-02-09 17:55:56,294 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting fe257ee514c14786be36a6eced30bd31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:56,294 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 6f2bda815e3e4334802b8ba01260a8ea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348737 2023-02-09 17:55:56,295 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 18d55acdbe4f4bb8a67fd253d2b5415f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:56,295 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 4c50a10e5d274d1984092b00ff9d3361, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:56,325 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): a2a95d2d23d1e33829f11de663dbf7e3#family1#compaction#151 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:56,339 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302095a2ceef4389f4c71a1308180a0bb1551_del 2023-02-09 17:55:56,339 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095a2ceef4389f4c71a1308180a0bb1551_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302095a2ceef4389f4c71a1308180a0bb1551_del 2023-02-09 17:55:56,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab] to archive 2023-02-09 17:55:56,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:56,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/759fe449adab495686c8bac52f998446 2023-02-09 17:55:56,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/8ff3407282054bc882b6d661b5aad790 2023-02-09 17:55:56,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/582ed9a06e28454db71dae079dd92dca 2023-02-09 17:55:56,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/1cb7fd9e30984f8c99face9a0dc635ad 2023-02-09 17:55:56,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family2/940462f8e28747c68589a33de67494ab 2023-02-09 17:55:57,155 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb94c33d0234af882c3c4f75a0ddf96 2023-02-09 17:55:57,155 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family1/8fb94c33d0234af882c3c4f75a0ddf96 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/8fb94c33d0234af882c3c4f75a0ddf96 2023-02-09 17:55:57,159 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb94c33d0234af882c3c4f75a0ddf96 2023-02-09 17:55:57,160 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a2a95d2d23d1e33829f11de663dbf7e3/family1 of a2a95d2d23d1e33829f11de663dbf7e3 into 8fb94c33d0234af882c3c4f75a0ddf96(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:57,160 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:57,160 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:57,160 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): a2a95d2d23d1e33829f11de663dbf7e3/family2 is initiating major compaction (all files) 2023-02-09 17:55:57,161 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:57,161 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:57,162 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of a2a95d2d23d1e33829f11de663dbf7e3/family2 in ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:55:57,162 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp, totalSize=25.3 K 2023-02-09 17:55:57,162 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 6a2d0536802c47ebb7ce0751f009aac1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345950 2023-02-09 17:55:57,163 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 846ef32c4b5c4427a0fde392eca78771, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:57,163 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 0b5f2a0ea9a845799ff7d89c6e6c650e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348737 2023-02-09 17:55:57,163 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting ebefb3ce53024586b36cbc8749bf8505, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:57,164 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8729cb7951324f29822ccb9ef60ed4ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:57,180 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): a2a95d2d23d1e33829f11de663dbf7e3#family2#compaction#152 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:57,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361] to archive 2023-02-09 17:55:57,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:57,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/61a74a566d7d44f3a7853045b23a720a 2023-02-09 17:55:57,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/fe257ee514c14786be36a6eced30bd31 2023-02-09 17:55:57,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/6f2bda815e3e4334802b8ba01260a8ea 2023-02-09 17:55:57,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/18d55acdbe4f4bb8a67fd253d2b5415f 2023-02-09 17:55:57,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/4c50a10e5d274d1984092b00ff9d3361 2023-02-09 17:55:57,590 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020988caf6aa531e4240ad0a064eb62639e0_del 2023-02-09 17:55:57,590 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020988caf6aa531e4240ad0a064eb62639e0_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020988caf6aa531e4240ad0a064eb62639e0_del 2023-02-09 17:55:57,606 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8560942200114e90815bdd2377c79928 2023-02-09 17:55:57,607 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/.tmp/family2/8560942200114e90815bdd2377c79928 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8560942200114e90815bdd2377c79928 2023-02-09 17:55:57,611 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8560942200114e90815bdd2377c79928 2023-02-09 17:55:57,612 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a2a95d2d23d1e33829f11de663dbf7e3/family2 of a2a95d2d23d1e33829f11de663dbf7e3 into 8560942200114e90815bdd2377c79928(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:57,612 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:57,612 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:57,612 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 3a1038bc277a0f83bb0fe93be1831eb3/family1 is initiating major compaction (all files) 2023-02-09 17:55:57,612 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:57,612 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:57,614 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 3a1038bc277a0f83bb0fe93be1831eb3/family1 in ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:57,615 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp, totalSize=26.6 K 2023-02-09 17:55:57,615 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c351398041f3416ea0fd99f9d3dacc35, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345949 2023-02-09 17:55:57,615 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 0ea9b2e13d5341c2a59723452f80ce75, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:57,616 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 94cd5dbaebac4cdcb5674e50aa8eb254, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348736 2023-02-09 17:55:57,616 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting ea5d2d3314f54cdbab02f99679dd4276, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:57,617 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 7ce4201dd30f40fcbd047d06f86d7b04, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:57,628 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 3a1038bc277a0f83bb0fe93be1831eb3#family1#compaction#153 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:57,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab] to archive 2023-02-09 17:55:57,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:57,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/6a2d0536802c47ebb7ce0751f009aac1 2023-02-09 17:55:57,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/846ef32c4b5c4427a0fde392eca78771 2023-02-09 17:55:57,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/0b5f2a0ea9a845799ff7d89c6e6c650e 2023-02-09 17:55:57,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/ebefb3ce53024586b36cbc8749bf8505 2023-02-09 17:55:57,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family2/8729cb7951324f29822ccb9ef60ed4ab 2023-02-09 17:55:58,041 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020998f5b3e879444f6cbcb58d67bc8d9b4b_del 2023-02-09 17:55:58,041 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020998f5b3e879444f6cbcb58d67bc8d9b4b_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020998f5b3e879444f6cbcb58d67bc8d9b4b_del 2023-02-09 17:55:58,462 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bce50d6f7ab642678f9ec572a88096a8 2023-02-09 17:55:58,463 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family1/bce50d6f7ab642678f9ec572a88096a8 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/bce50d6f7ab642678f9ec572a88096a8 2023-02-09 17:55:58,467 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bce50d6f7ab642678f9ec572a88096a8 2023-02-09 17:55:58,468 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3a1038bc277a0f83bb0fe93be1831eb3/family1 of 3a1038bc277a0f83bb0fe93be1831eb3 into bce50d6f7ab642678f9ec572a88096a8(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:58,469 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:58,469 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:55:58,469 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 3a1038bc277a0f83bb0fe93be1831eb3/family2 is initiating major compaction (all files) 2023-02-09 17:55:58,469 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:55:58,469 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:55:58,469 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 3a1038bc277a0f83bb0fe93be1831eb3/family2 in ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:55:58,469 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp, totalSize=25.3 K 2023-02-09 17:55:58,470 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting b398c29c46c546da9a7fddb555220d85, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965345949 2023-02-09 17:55:58,470 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting f29ca2ba88514cf7b60346c519172207, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965347739 2023-02-09 17:55:58,471 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting b27f9209ba0c48b0930bdf7d7beff25b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965348736 2023-02-09 17:55:58,472 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 828d499881be4e0ba90d69b661591c7a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965350541 2023-02-09 17:55:58,474 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting ec7fc39d2dfc40d5bd0391ef7d4a005f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:55:58,487 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 3a1038bc277a0f83bb0fe93be1831eb3#family2#compaction#154 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:55:58,509 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302095112fef1e4854d25b10f33360ee33802_del 2023-02-09 17:55:58,509 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302095112fef1e4854d25b10f33360ee33802_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302095112fef1e4854d25b10f33360ee33802_del 2023-02-09 17:55:58,531 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9adee9e57c1b434b957621c12c9459d0 2023-02-09 17:55:58,532 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/.tmp/family2/9adee9e57c1b434b957621c12c9459d0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/9adee9e57c1b434b957621c12c9459d0 2023-02-09 17:55:58,536 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9adee9e57c1b434b957621c12c9459d0 2023-02-09 17:55:58,537 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3a1038bc277a0f83bb0fe93be1831eb3/family2 of 3a1038bc277a0f83bb0fe93be1831eb3 into 9adee9e57c1b434b957621c12c9459d0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:55:58,537 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:58,542 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:58,545 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:58,549 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:58,549 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:58,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04] to archive 2023-02-09 17:55:58,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:58,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/c351398041f3416ea0fd99f9d3dacc35 2023-02-09 17:55:58,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/0ea9b2e13d5341c2a59723452f80ce75 2023-02-09 17:55:58,556 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:55:58,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/94cd5dbaebac4cdcb5674e50aa8eb254 2023-02-09 17:55:58,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/ea5d2d3314f54cdbab02f99679dd4276 2023-02-09 17:55:58,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/7ce4201dd30f40fcbd047d06f86d7b04 2023-02-09 17:55:58,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f] to archive 2023-02-09 17:55:58,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:58,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b398c29c46c546da9a7fddb555220d85 2023-02-09 17:55:58,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/f29ca2ba88514cf7b60346c519172207 2023-02-09 17:55:58,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/b27f9209ba0c48b0930bdf7d7beff25b 2023-02-09 17:55:58,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/828d499881be4e0ba90d69b661591c7a 2023-02-09 17:55:58,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family2/ec7fc39d2dfc40d5bd0391ef7d4a005f 2023-02-09 17:55:58,575 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-09 17:55:58,577 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020998f5b3e879444f6cbcb58d67bc8d9b4b_del 2023-02-09 17:55:58,581 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302095a2ceef4389f4c71a1308180a0bb1551_del 2023-02-09 17:55:58,583 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302093fea43e07c014b52ba23877fcb4a52c6_del 2023-02-09 17:55:58,584 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:58,584 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(139): Connect 0x347ce065 to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:55:58,589 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f92651e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:55:58,590 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:58,590 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:58,590 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:58,649 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a2c7c20384ed44cc93d7fdca49f34dcf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209a2c7c20384ed44cc93d7fdca49f34dcf 2023-02-09 17:55:58,650 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:58,668 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:55:58,678 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:55:58,686 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:58,686 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:58,686 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:55:58,690 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59026, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:55:58,703 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/8b614362ea844cd4a48ac4eb896a2aa1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-09 17:55:58,703 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/8b614362ea844cd4a48ac4eb896a2aa1}] 2023-02-09 17:55:58,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/8b614362ea844cd4a48ac4eb896a2aa1 for inclusion in b0fcebcd287c1ba929a1f12243ab2520/family1 2023-02-09 17:55:58,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-09 17:55:58,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 17:55:58,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for b0fcebcd287c1ba929a1f12243ab2520: 2023-02-09 17:55:58,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/8b614362ea844cd4a48ac4eb896a2aa1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__13u3jktj1fmkur8lffegep5tkrop54li1g7gu99ki13rvdshl5g6rs3jihausrjd/family1/8b614362ea844cd4a48ac4eb896a2aa1 2023-02-09 17:55:58,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__13u3jktj1fmkur8lffegep5tkrop54li1g7gu99ki13rvdshl5g6rs3jihausrjd/family1/8b614362ea844cd4a48ac4eb896a2aa1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/53dafa60ecaa4e829603c3b27723609a_SeqId_28_ 2023-02-09 17:55:58,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__13u3jktj1fmkur8lffegep5tkrop54li1g7gu99ki13rvdshl5g6rs3jihausrjd/family1/8b614362ea844cd4a48ac4eb896a2aa1 into b0fcebcd287c1ba929a1f12243ab2520/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/53dafa60ecaa4e829603c3b27723609a_SeqId_28_ - updating store file list. 2023-02-09 17:55:58,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/53dafa60ecaa4e829603c3b27723609a_SeqId_28_ into b0fcebcd287c1ba929a1f12243ab2520/family1 2023-02-09 17:55:58,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__13u3jktj1fmkur8lffegep5tkrop54li1g7gu99ki13rvdshl5g6rs3jihausrjd/family1/8b614362ea844cd4a48ac4eb896a2aa1 into b0fcebcd287c1ba929a1f12243ab2520/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/family1/53dafa60ecaa4e829603c3b27723609a_SeqId_28_) 2023-02-09 17:55:58,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__13u3jktj1fmkur8lffegep5tkrop54li1g7gu99ki13rvdshl5g6rs3jihausrjd/family1/8b614362ea844cd4a48ac4eb896a2aa1 2023-02-09 17:55:58,722 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:58,723 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:58,724 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209a4ab55d568904e5fafd2b6ddef3358fd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209a4ab55d568904e5fafd2b6ddef3358fd 2023-02-09 17:55:58,724 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 17:55:58,724 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 17:55:58,725 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:59,051 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209c2771615eae14cc9a7e8c613dce52823 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209c2771615eae14cc9a7e8c613dce52823 2023-02-09 17:55:59,052 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:59,073 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,073 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,084 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0d680d2cc9044d4393cde0acb58b7685 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-09 17:55:59,085 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0d680d2cc9044d4393cde0acb58b7685}] 2023-02-09 17:55:59,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0d680d2cc9044d4393cde0acb58b7685 for inclusion in 3a1038bc277a0f83bb0fe93be1831eb3/family1 2023-02-09 17:55:59,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-09 17:55:59,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 17:55:59,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 3a1038bc277a0f83bb0fe93be1831eb3: 2023-02-09 17:55:59,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0d680d2cc9044d4393cde0acb58b7685 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__gmbsfidcfsjvhjmaejnbe5467ojos2j814t6brqjjuh06qdvlhggojgesgqs9ana/family1/0d680d2cc9044d4393cde0acb58b7685 2023-02-09 17:55:59,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__gmbsfidcfsjvhjmaejnbe5467ojos2j814t6brqjjuh06qdvlhggojgesgqs9ana/family1/0d680d2cc9044d4393cde0acb58b7685 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/5904bb92ab474bc2adc6a20a06270063_SeqId_28_ 2023-02-09 17:55:59,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__gmbsfidcfsjvhjmaejnbe5467ojos2j814t6brqjjuh06qdvlhggojgesgqs9ana/family1/0d680d2cc9044d4393cde0acb58b7685 into 3a1038bc277a0f83bb0fe93be1831eb3/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/5904bb92ab474bc2adc6a20a06270063_SeqId_28_ - updating store file list. 2023-02-09 17:55:59,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/5904bb92ab474bc2adc6a20a06270063_SeqId_28_ into 3a1038bc277a0f83bb0fe93be1831eb3/family1 2023-02-09 17:55:59,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__gmbsfidcfsjvhjmaejnbe5467ojos2j814t6brqjjuh06qdvlhggojgesgqs9ana/family1/0d680d2cc9044d4393cde0acb58b7685 into 3a1038bc277a0f83bb0fe93be1831eb3/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/family1/5904bb92ab474bc2adc6a20a06270063_SeqId_28_) 2023-02-09 17:55:59,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__gmbsfidcfsjvhjmaejnbe5467ojos2j814t6brqjjuh06qdvlhggojgesgqs9ana/family1/0d680d2cc9044d4393cde0acb58b7685 2023-02-09 17:55:59,103 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:59,103 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:59,105 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209bf5c2da8357b4d91b5a8b5bd544268af to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209bf5c2da8357b4d91b5a8b5bd544268af 2023-02-09 17:55:59,105 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 17:55:59,106 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 17:55:59,106 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:59,437 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209e7f67612cd6e4d6e896d4d7054bda718 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209e7f67612cd6e4d6e896d4d7054bda718 2023-02-09 17:55:59,438 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:59,458 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,458 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,466 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/abd3c1a29c8b45238b2718640d9d369c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-09 17:55:59,468 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/abd3c1a29c8b45238b2718640d9d369c}] 2023-02-09 17:55:59,470 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/abd3c1a29c8b45238b2718640d9d369c for inclusion in a2a95d2d23d1e33829f11de663dbf7e3/family1 2023-02-09 17:55:59,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-09 17:55:59,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 17:55:59,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for a2a95d2d23d1e33829f11de663dbf7e3: 2023-02-09 17:55:59,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/abd3c1a29c8b45238b2718640d9d369c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__trdjgt0dvaperet2ubphmgjktrr7ioct4pgd9mquscn3i6j3jv9v0kses70en4pu/family1/abd3c1a29c8b45238b2718640d9d369c 2023-02-09 17:55:59,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__trdjgt0dvaperet2ubphmgjktrr7ioct4pgd9mquscn3i6j3jv9v0kses70en4pu/family1/abd3c1a29c8b45238b2718640d9d369c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/c0132a92f9574a02b0d1e848ae0f250b_SeqId_28_ 2023-02-09 17:55:59,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__trdjgt0dvaperet2ubphmgjktrr7ioct4pgd9mquscn3i6j3jv9v0kses70en4pu/family1/abd3c1a29c8b45238b2718640d9d369c into a2a95d2d23d1e33829f11de663dbf7e3/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/c0132a92f9574a02b0d1e848ae0f250b_SeqId_28_ - updating store file list. 2023-02-09 17:55:59,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/c0132a92f9574a02b0d1e848ae0f250b_SeqId_28_ into a2a95d2d23d1e33829f11de663dbf7e3/family1 2023-02-09 17:55:59,479 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__trdjgt0dvaperet2ubphmgjktrr7ioct4pgd9mquscn3i6j3jv9v0kses70en4pu/family1/abd3c1a29c8b45238b2718640d9d369c into a2a95d2d23d1e33829f11de663dbf7e3/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/family1/c0132a92f9574a02b0d1e848ae0f250b_SeqId_28_) 2023-02-09 17:55:59,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__ns_testMinorCompaction__trdjgt0dvaperet2ubphmgjktrr7ioct4pgd9mquscn3i6j3jv9v0kses70en4pu/family1/abd3c1a29c8b45238b2718640d9d369c 2023-02-09 17:55:59,481 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:59,481 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:55:59,483 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209111e485d8f4c46cb93c05a33ebbeb45f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209111e485d8f4c46cb93c05a33ebbeb45f 2023-02-09 17:55:59,483 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 17:55:59,483 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 17:55:59,483 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 17:55:59,483 INFO [Listener at localhost/44673] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-09 17:55:59,485 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:59,487 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:59,490 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:55:59,491 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:55:59,511 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=252 (was 279), OpenFileDescriptor=642 (was 745), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=3299 (was 2952) - AvailableMemoryMB LEAK? - 2023-02-09 17:55:59,526 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=168, AvailableMemoryMB=3298 2023-02-09 17:55:59,526 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,526 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 17:55:59,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-09 17:55:59,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:55:59,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-09 17:55:59,531 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,531 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:55:59,531 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:55:59,532 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:55:59,533 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19 empty. 2023-02-09 17:55:59,533 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:55:59,533 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-09 17:55:59,632 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,632 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:55:59,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:55:59,834 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:55:59,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:55:59,941 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 17:55:59,942 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6612fb614c1536599d8d0aed042fbe19, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:56:00,135 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:00,135 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:00,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 6612fb614c1536599d8d0aed042fbe19, disabling compactions & flushes 2023-02-09 17:56:00,348 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. after waiting 0 ms 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,348 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,348 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 6612fb614c1536599d8d0aed042fbe19: Waiting for close lock at 1675965360348Disabling compacts and flushes for region at 1675965360348Disabling writes for close at 1675965360348Writing region close event to WAL at 1675965360348Closed at 1675965360348 2023-02-09 17:56:00,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:56:00,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965360351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965360351"}]},"ts":"1675965360351"} 2023-02-09 17:56:00,352 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 17:56:00,353 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:56:00,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965360353"}]},"ts":"1675965360353"} 2023-02-09 17:56:00,354 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 17:56:00,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6612fb614c1536599d8d0aed042fbe19, ASSIGN}] 2023-02-09 17:56:00,361 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6612fb614c1536599d8d0aed042fbe19, ASSIGN 2023-02-09 17:56:00,362 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6612fb614c1536599d8d0aed042fbe19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:56:00,513 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6612fb614c1536599d8d0aed042fbe19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:00,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965360513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965360513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965360513"}]},"ts":"1675965360513"} 2023-02-09 17:56:00,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 6612fb614c1536599d8d0aed042fbe19, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:56:00,636 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:00,636 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:00,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:56:00,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6612fb614c1536599d8d0aed042fbe19, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.', STARTKEY => '', ENDKEY => ''} 2023-02-09 17:56:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,670 INFO [StoreOpener-6612fb614c1536599d8d0aed042fbe19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,671 DEBUG [StoreOpener-6612fb614c1536599d8d0aed042fbe19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:00,671 DEBUG [StoreOpener-6612fb614c1536599d8d0aed042fbe19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:00,672 INFO [StoreOpener-6612fb614c1536599d8d0aed042fbe19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6612fb614c1536599d8d0aed042fbe19 columnFamilyName family1 2023-02-09 17:56:00,673 INFO [StoreOpener-6612fb614c1536599d8d0aed042fbe19-1] regionserver.HStore(310): Store=6612fb614c1536599d8d0aed042fbe19/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:00,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:00,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:56:00,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6612fb614c1536599d8d0aed042fbe19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70756195, jitterRate=0.054349467158317566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 17:56:00,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6612fb614c1536599d8d0aed042fbe19: Running coprocessor pre-open hook at 1675965360669Writing region info on filesystem at 1675965360669Initializing all the Stores at 1675965360670 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675965360670Cleaning up temporary data from old regions at 1675965360674 (+4 ms)Cleaning up detritus from prior splits at 1675965360674Running coprocessor post-open hooks at 1675965360678 (+4 ms)Region opened successfully at 1675965360678 2023-02-09 17:56:00,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., pid=114, masterSystemTime=1675965360666 2023-02-09 17:56:00,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:00,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6612fb614c1536599d8d0aed042fbe19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:00,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675965360680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965360680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965360680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965360680"}]},"ts":"1675965360680"} 2023-02-09 17:56:00,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-09 17:56:00,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 6612fb614c1536599d8d0aed042fbe19, server=jenkins-hbase4.apache.org,42581,1675965218218 in 166 msec 2023-02-09 17:56:00,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-09 17:56:00,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6612fb614c1536599d8d0aed042fbe19, ASSIGN in 322 msec 2023-02-09 17:56:00,684 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:56:00,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965360684"}]},"ts":"1675965360684"} 2023-02-09 17:56:00,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 17:56:00,688 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:56:00,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1600 sec 2023-02-09 17:56:01,638 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:01,638 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:01,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 17:56:01,639 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-09 17:56:01,655 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:01,655 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:01,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:01,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,657 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:01,657 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:01,657 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:01,657 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:01,658 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,658 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,659 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:01,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:01,659 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:01,659 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,659 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:01,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:01,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:01,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:01,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:01,661 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:01,661 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:01,662 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 17:56:01,686 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ba45fc02cb92418397b9251833c3209c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba45fc02cb92418397b9251833c3209c 2023-02-09 17:56:01,689 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7ed6bcf6b9814f82b9a26f5f3cda145a 2023-02-09 17:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7ed6bcf6b9814f82b9a26f5f3cda145a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a 2023-02-09 17:56:01,697 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 17:56:01,698 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 36ms, sequenceid=5, compaction requested=false 2023-02-09 17:56:01,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:01,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:01,698 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:01,700 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:01,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:01,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4886b548[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:01,702 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:01,702 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,703 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:01,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:01,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:01,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:01,706 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:01,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:01,708 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:01,708 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:01,708 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:01,708 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,708 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:01,710 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,710 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:01,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,710 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,710 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,712 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:01,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:01,714 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:01,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:01,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:01,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:01,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:01,714 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:01,715 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:01,815 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:01,815 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:01,815 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:01,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:01,820 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:01,820 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:01,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:01,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:01,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,822 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:01,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:01,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:01,822 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:01,823 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,823 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,824 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:01,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:01,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:01,824 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,825 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:01,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:01,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:01,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:01,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:01,825 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:01,826 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:01,826 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:01,826 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 17:56:02,240 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283e0c836009144a00b5a2824f37d32319 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283e0c836009144a00b5a2824f37d32319 2023-02-09 17:56:02,645 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/5fecc6c5c5064255b460151da623b6e9 2023-02-09 17:56:02,649 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/5fecc6c5c5064255b460151da623b6e9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9 2023-02-09 17:56:02,652 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 17:56:02,653 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 827ms, sequenceid=9, compaction requested=false 2023-02-09 17:56:02,653 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:02,653 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:02,653 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,656 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:02,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:02,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5502f870[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:02,658 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:02,658 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,659 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,659 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:02,659 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:02,659 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:02,659 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,659 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:02,660 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:02,660 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,660 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,661 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:02,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:02,663 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:02,663 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:02,663 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:02,663 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,663 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:02,665 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,665 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:02,665 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:02,666 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,667 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:02,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:02,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:02,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:02,670 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:02,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:02,671 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:02,671 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:02,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:02,771 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:02,771 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:02,771 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:02,775 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:02,776 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:02,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,778 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:02,778 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:02,778 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:02,778 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:02,778 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,778 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,784 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:02,784 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:02,784 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:02,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,784 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:02,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:02,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,785 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,785 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:02,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:02,785 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:02,785 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:02,785 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:02,786 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:03,198 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120176414802eb094f0391488cea57adb06d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120176414802eb094f0391488cea57adb06d 2023-02-09 17:56:03,603 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/f1231bd058e447a9b79ada553e180bab 2023-02-09 17:56:03,607 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/f1231bd058e447a9b79ada553e180bab as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab 2023-02-09 17:56:03,611 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 17:56:03,612 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 826ms, sequenceid=13, compaction requested=true 2023-02-09 17:56:03,613 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:03,613 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:03,613 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:03,616 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:03,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,616 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:03,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:03,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@507e06d7[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:03,617 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:03,617 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,620 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:03,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:03,620 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:03,620 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,620 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:03,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:03,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:03,621 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,621 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:03,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:03,624 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:03,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:03,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:03,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,624 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:03,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:03,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:03,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:03,626 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:03,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,627 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:03,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,629 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:03,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:03,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:03,629 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:03,630 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:03,630 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:03,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:03,630 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,630 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:03,630 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:03,730 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:03,730 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:03,730 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:03,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:03,734 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:03,734 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:03,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:03,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:03,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,736 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:03,736 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:03,736 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:03,736 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:03,737 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,737 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,739 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,739 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:03,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:03,739 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:03,739 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,740 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,740 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:03,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:03,741 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:03,741 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:03,741 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:03,741 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:04,152 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a786cd4fe23645cead4d3fee4f470ee3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205a786cd4fe23645cead4d3fee4f470ee3 2023-02-09 17:56:04,557 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/aa4d1eb66b484fe1a5039a2215f8e4d6 2023-02-09 17:56:04,562 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/aa4d1eb66b484fe1a5039a2215f8e4d6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6 2023-02-09 17:56:04,565 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 17:56:04,566 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 825ms, sequenceid=17, compaction requested=true 2023-02-09 17:56:04,566 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:04,566 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:04,567 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:04,568 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,568 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,569 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:04,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42e049c2[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:04,570 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:04,570 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,571 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:04,571 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:04,572 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,572 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:04,573 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:04,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:04,575 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:04,575 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:04,575 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:04,575 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,575 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:04,577 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,577 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:04,577 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:04,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:04,578 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,579 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,581 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:04,581 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:04,581 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,581 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:04,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:04,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:04,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:04,581 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:04,582 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:04,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:04,682 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:04,682 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:04,682 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:04,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:04,686 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:04,686 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:04,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:04,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:04,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,688 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:04,689 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:04,689 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:04,699 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:04,700 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,700 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,706 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:56:04,706 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x347ce065 to 127.0.0.1:59572 2023-02-09 17:56:04,706 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:04,709 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:56:04,709 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7be576da to 127.0.0.1:59572 2023-02-09 17:56:04,709 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:04,709 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:04,709 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:04,711 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:04,712 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:04,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:04,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:04,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:04,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:04,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:04,713 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:04,713 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:04,713 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:04,713 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:05,129 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122845acd3a4cd594aff9c98059d43765c84 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122845acd3a4cd594aff9c98059d43765c84 2023-02-09 17:56:05,535 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/3f16ab7bfa39405683c18d20d33f5739 2023-02-09 17:56:05,539 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/3f16ab7bfa39405683c18d20d33f5739 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739 2023-02-09 17:56:05,543 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 17:56:05,543 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 830ms, sequenceid=21, compaction requested=true 2023-02-09 17:56:05,543 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:05,543 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:05,544 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:05,544 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:05,544 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,544 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:05,544 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:05,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,545 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:05,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,545 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:05,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:05,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fb18823[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:05,547 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:05,547 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,548 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:05,548 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:05,548 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,548 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:05,549 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:05,549 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:05,550 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:05,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:05,552 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:05,552 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:05,552 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:05,552 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,552 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:05,554 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,554 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,554 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:05,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,555 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:05,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,556 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:05,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:05,560 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:05,560 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,561 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,561 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,561 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,561 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:05,561 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:05,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:05,661 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:05,661 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:05,661 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:05,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:05,665 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:05,665 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:05,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:05,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:05,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,667 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:05,668 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:05,668 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:05,668 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:05,668 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,668 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,669 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,669 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:05,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:05,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:05,670 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:05,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:05,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:05,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:05,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:05,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:05,671 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:05,671 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:05,671 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:05,672 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:06,087 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123193c0327bc3114df1a246df3d37365028 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123193c0327bc3114df1a246df3d37365028 2023-02-09 17:56:06,210 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:56:06,492 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7211d442501649f7b6e0ad5b0f1733e9 2023-02-09 17:56:06,496 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7211d442501649f7b6e0ad5b0f1733e9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9 2023-02-09 17:56:06,499 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 17:56:06,500 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 828ms, sequenceid=25, compaction requested=true 2023-02-09 17:56:06,500 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:06,500 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:06,502 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,502 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:06,502 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,502 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:06,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:06,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db226dd[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:06,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:06,504 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,505 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:06,505 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:06,505 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,505 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:06,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:06,506 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:06,506 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:06,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:06,508 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:06,509 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:06,509 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:06,509 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,509 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:06,511 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,511 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,511 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:06,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:06,512 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:06,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,513 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:06,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:06,515 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:06,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:06,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:06,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,515 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:06,516 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:06,516 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:06,616 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:06,616 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:06,616 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:06,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:06,620 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:06,620 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:06,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:06,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:06,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,622 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:06,622 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:06,622 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:06,622 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:06,623 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,623 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,624 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:06,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:06,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:06,624 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,625 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:06,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:06,625 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:06,625 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:06,625 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:06,625 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:06,625 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:06,625 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:06,625 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:06,625 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:07,037 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011537ada332304d2991903a3dde9759fa to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011537ada332304d2991903a3dde9759fa 2023-02-09 17:56:07,442 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/4d1da20716e44d9cae74af425f4c0ba9 2023-02-09 17:56:07,445 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/4d1da20716e44d9cae74af425f4c0ba9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9 2023-02-09 17:56:07,448 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 17:56:07,449 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 824ms, sequenceid=29, compaction requested=true 2023-02-09 17:56:07,449 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:07,449 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:07,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:07,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:07,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:07,449 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,451 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:07,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:07,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:07,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ddadf02[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:07,452 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:07,452 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,455 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:07,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:07,456 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:07,456 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,456 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:07,457 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:07,457 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:07,457 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,457 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:07,459 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:07,459 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:07,459 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:07,459 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,459 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:07,460 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,460 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:07,461 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:07,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:07,461 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,462 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:07,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:07,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,464 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:07,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:07,465 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:07,464 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,465 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:07,465 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,465 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,465 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,565 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:07,565 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:07,565 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:07,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:07,569 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:07,569 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:07,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:07,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:07,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,571 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:07,571 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:07,571 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:07,571 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:07,572 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,572 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,574 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,574 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:07,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:07,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:07,574 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:07,574 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:07,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:07,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,575 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:07,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:07,575 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:07,575 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:07,575 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:07,576 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:07,576 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:07,576 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:07,576 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:07,576 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:07,987 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034e446e9662c84f2abf93d3fc9b479b83 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034e446e9662c84f2abf93d3fc9b479b83 2023-02-09 17:56:08,391 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7296e2e9482c4c45a627f3fbe6e62e6b 2023-02-09 17:56:08,395 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/7296e2e9482c4c45a627f3fbe6e62e6b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b 2023-02-09 17:56:08,399 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 17:56:08,399 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 823ms, sequenceid=33, compaction requested=true 2023-02-09 17:56:08,399 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:08,399 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:08,400 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:08,401 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,401 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:08,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1db42322[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:08,403 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:08,403 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,404 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:08,404 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:08,404 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,404 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:08,405 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:08,405 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,405 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,405 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:08,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:08,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:08,407 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:08,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:08,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:08,407 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,407 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:08,412 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,412 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,413 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,415 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:08,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:08,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:08,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:08,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:08,415 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,416 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:08,416 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:08,416 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,516 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:08,516 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:08,516 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:08,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:08,520 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:08,520 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:08,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,523 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:08,523 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:08,523 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:08,523 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:08,523 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,523 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,525 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:08,525 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:08,525 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,525 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:08,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,526 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,526 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:08,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:08,526 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:08,527 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:08,527 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:08,537 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070453f487c2b14de184ac2b34bf06cff1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509070453f487c2b14de184ac2b34bf06cff1 2023-02-09 17:56:08,947 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/3c399cf59d1b45cb97651bd3f5d3bc87 2023-02-09 17:56:08,951 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/3c399cf59d1b45cb97651bd3f5d3bc87 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87 2023-02-09 17:56:08,954 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 17:56:08,954 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 427ms, sequenceid=37, compaction requested=true 2023-02-09 17:56:08,955 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:08,955 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:08,956 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,956 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,957 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:08,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e775027[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:08,958 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:08,958 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,960 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,960 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:08,960 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,960 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:08,960 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:08,960 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:08,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:08,961 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,961 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:08,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:08,963 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:08,963 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:08,963 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:08,963 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,963 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:08,965 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,965 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:08,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,965 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:08,965 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,966 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:08,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:08,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:08,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,968 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:08,968 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:08,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:08,969 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:09,069 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:09,069 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:09,069 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:09,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:09,073 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:09,073 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:09,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:09,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:09,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,076 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:09,076 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:09,076 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 17:56:09,076 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 17:56:09,076 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,076 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,078 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:09,078 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:09,079 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,079 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:09,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:09,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,080 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 17:56:09,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 17:56:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 17:56:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 17:56:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:09,080 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:09,080 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. started... 2023-02-09 17:56:09,080 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6612fb614c1536599d8d0aed042fbe19 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 17:56:09,491 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c48041eaa19646e194cd26390dd4a2f3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c48041eaa19646e194cd26390dd4a2f3 2023-02-09 17:56:09,897 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/437cae21974d4281841f54a33a8e773b 2023-02-09 17:56:09,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/437cae21974d4281841f54a33a8e773b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b 2023-02-09 17:56:09,903 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 17:56:09,904 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6612fb614c1536599d8d0aed042fbe19 in 824ms, sequenceid=41, compaction requested=true 2023-02-09 17:56:09,904 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:09,904 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:09,904 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 17:56:09,904 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 17:56:09,904 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,904 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 17:56:09,905 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 17:56:09,906 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,906 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:09,906 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,906 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 17:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@421f0ffa[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:09,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 17:56:09,907 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,908 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,908 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 17:56:09,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 17:56:09,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:09,909 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,909 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:09,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 17:56:09,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:09,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 17:56:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:09,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 17:56:09,912 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 17:56:09,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:09,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:09,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,912 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:09,914 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,914 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:09,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,914 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:09,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:09,915 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,916 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:09,918 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:09,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 17:56:09,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:09,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:09,918 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:09,919 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:10,019 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:10,019 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:10,019 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:10,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:10,021 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-09 17:56:10,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:56:10,023 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:56:10,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:56:10,024 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965970024 2023-02-09 17:56:10,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 17:56:10,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 17:56:10,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:10,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x45f93e8d to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:56:10,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a1fd3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:56:10,031 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:10,861 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034bbd364cdc884923bfdff3bb81377b40 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034bbd364cdc884923bfdff3bb81377b40 2023-02-09 17:56:10,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:10,879 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:56:10,882 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56348, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:56:10,887 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:10,887 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:10,888 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:56:10,889 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46848, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:56:10,897 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f0a5fc1736c24552bc9a6fed5b92d37d first=Optional[r5] last=Optional[r6] 2023-02-09 17:56:10,898 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f0a5fc1736c24552bc9a6fed5b92d37d}] 2023-02-09 17:56:10,905 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f0a5fc1736c24552bc9a6fed5b92d37d for inclusion in 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:10,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 17:56:10,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:56:10,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:10,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f0a5fc1736c24552bc9a6fed5b92d37d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58o4c8m6hdign99fondqgcrgctvqhsujofqug7470e174tqn1fam9ln6mq6ldsfj/family1/f0a5fc1736c24552bc9a6fed5b92d37d 2023-02-09 17:56:10,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58o4c8m6hdign99fondqgcrgctvqhsujofqug7470e174tqn1fam9ln6mq6ldsfj/family1/f0a5fc1736c24552bc9a6fed5b92d37d as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_ 2023-02-09 17:56:10,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58o4c8m6hdign99fondqgcrgctvqhsujofqug7470e174tqn1fam9ln6mq6ldsfj/family1/f0a5fc1736c24552bc9a6fed5b92d37d into 6612fb614c1536599d8d0aed042fbe19/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_ - updating store file list. 2023-02-09 17:56:10,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_ into 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:10,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58o4c8m6hdign99fondqgcrgctvqhsujofqug7470e174tqn1fam9ln6mq6ldsfj/family1/f0a5fc1736c24552bc9a6fed5b92d37d into 6612fb614c1536599d8d0aed042fbe19/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_) 2023-02-09 17:56:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__58o4c8m6hdign99fondqgcrgctvqhsujofqug7470e174tqn1fam9ln6mq6ldsfj/family1/f0a5fc1736c24552bc9a6fed5b92d37d 2023-02-09 17:56:10,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 17:56:10,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 17:56:10,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(1912): 6612fb614c1536599d8d0aed042fbe19/family1 is initiating minor compaction 2023-02-09 17:56:10,918 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6612fb614c1536599d8d0aed042fbe19/family1 in testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:10,918 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp, totalSize=49.7 K 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 5fecc6c5c5064255b460151da623b6e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting f1231bd058e447a9b79ada553e180bab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting aa4d1eb66b484fe1a5039a2215f8e4d6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3f16ab7bfa39405683c18d20d33f5739, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 7211d442501649f7b6e0ad5b0f1733e9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 4d1da20716e44d9cae74af425f4c0ba9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 17:56:10,918 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 7296e2e9482c4c45a627f3fbe6e62e6b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 17:56:10,919 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 3c399cf59d1b45cb97651bd3f5d3bc87, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 17:56:10,919 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 437cae21974d4281841f54a33a8e773b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 17:56:10,919 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 83e9f79290fb41deaad6e85a5517a18f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 17:56:10,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@77b52443; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:56:10,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:10,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:10,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011537ada332304d2991903a3dde9759fa to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011537ada332304d2991903a3dde9759fa 2023-02-09 17:56:10,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034e446e9662c84f2abf93d3fc9b479b83 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034e446e9662c84f2abf93d3fc9b479b83 2023-02-09 17:56:10,926 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 17:56:10,926 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 17:56:10,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:10,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:10,951 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6612fb614c1536599d8d0aed042fbe19#family1#compaction#165 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:10,973 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/296d396e4413461c8191373edb65e5c1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/296d396e4413461c8191373edb65e5c1 2023-02-09 17:56:10,978 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6612fb614c1536599d8d0aed042fbe19/family1 of 6612fb614c1536599d8d0aed042fbe19 into 296d396e4413461c8191373edb65e5c1(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:56:10,978 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:10,978 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675965370918; duration=0sec 2023-02-09 17:56:10,978 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:56:11,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_] to archive 2023-02-09 17:56:11,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:11,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/5fecc6c5c5064255b460151da623b6e9 2023-02-09 17:56:11,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/f1231bd058e447a9b79ada553e180bab 2023-02-09 17:56:11,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/aa4d1eb66b484fe1a5039a2215f8e4d6 2023-02-09 17:56:11,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3f16ab7bfa39405683c18d20d33f5739 2023-02-09 17:56:11,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7211d442501649f7b6e0ad5b0f1733e9 2023-02-09 17:56:11,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/4d1da20716e44d9cae74af425f4c0ba9 2023-02-09 17:56:11,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7296e2e9482c4c45a627f3fbe6e62e6b 2023-02-09 17:56:11,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/3c399cf59d1b45cb97651bd3f5d3bc87 2023-02-09 17:56:11,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/437cae21974d4281841f54a33a8e773b 2023-02-09 17:56:11,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/83e9f79290fb41deaad6e85a5517a18f_SeqId_44_ 2023-02-09 17:56:11,782 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314412e59b7e724f6184a2298ed54e0719 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314412e59b7e724f6184a2298ed54e0719 2023-02-09 17:56:11,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:11,798 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:11,798 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:11,804 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/58c55ac196ca43a591721ac1e3624666 first=Optional[r1] last=Optional[r4] 2023-02-09 17:56:11,805 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/58c55ac196ca43a591721ac1e3624666}] 2023-02-09 17:56:11,807 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/58c55ac196ca43a591721ac1e3624666 for inclusion in 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:11,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 17:56:11,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:56:11,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:11,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/58c55ac196ca43a591721ac1e3624666 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__us7jrgkvppialpuneduo3lav578jd4hjc3hhfivi828kbremaefd7li8skd9sqlb/family1/58c55ac196ca43a591721ac1e3624666 2023-02-09 17:56:11,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__us7jrgkvppialpuneduo3lav578jd4hjc3hhfivi828kbremaefd7li8skd9sqlb/family1/58c55ac196ca43a591721ac1e3624666 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_ 2023-02-09 17:56:11,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__us7jrgkvppialpuneduo3lav578jd4hjc3hhfivi828kbremaefd7li8skd9sqlb/family1/58c55ac196ca43a591721ac1e3624666 into 6612fb614c1536599d8d0aed042fbe19/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_ - updating store file list. 2023-02-09 17:56:11,818 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_ into 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:11,818 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__us7jrgkvppialpuneduo3lav578jd4hjc3hhfivi828kbremaefd7li8skd9sqlb/family1/58c55ac196ca43a591721ac1e3624666 into 6612fb614c1536599d8d0aed042fbe19/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_) 2023-02-09 17:56:11,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__us7jrgkvppialpuneduo3lav578jd4hjc3hhfivi828kbremaefd7li8skd9sqlb/family1/58c55ac196ca43a591721ac1e3624666 2023-02-09 17:56:11,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 17:56:11,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 17:56:11,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(1912): 6612fb614c1536599d8d0aed042fbe19/family1 is initiating minor compaction (all files) 2023-02-09 17:56:11,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@469997d4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:56:11,820 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6612fb614c1536599d8d0aed042fbe19/family1 in testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:11,820 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/296d396e4413461c8191373edb65e5c1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp, totalSize=178.1 K 2023-02-09 17:56:11,821 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 7ed6bcf6b9814f82b9a26f5f3cda145a, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842209 2023-02-09 17:56:11,821 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting 296d396e4413461c8191373edb65e5c1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242209 2023-02-09 17:56:11,822 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] compactions.Compactor(207): Compacting dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242209 2023-02-09 17:56:11,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:11,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:11,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120176414802eb094f0391488cea57adb06d to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120176414802eb094f0391488cea57adb06d 2023-02-09 17:56:11,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205a786cd4fe23645cead4d3fee4f470ee3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205a786cd4fe23645cead4d3fee4f470ee3 2023-02-09 17:56:11,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122845acd3a4cd594aff9c98059d43765c84 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122845acd3a4cd594aff9c98059d43765c84 2023-02-09 17:56:11,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123193c0327bc3114df1a246df3d37365028 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123193c0327bc3114df1a246df3d37365028 2023-02-09 17:56:11,832 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 17:56:11,833 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 17:56:11,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:11,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:11,840 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6612fb614c1536599d8d0aed042fbe19#family1#compaction#166 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:12,664 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/.tmp/family1/0155b20338d54bebbcc5a884b22c089c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/0155b20338d54bebbcc5a884b22c089c 2023-02-09 17:56:12,668 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6612fb614c1536599d8d0aed042fbe19/family1 of 6612fb614c1536599d8d0aed042fbe19 into 0155b20338d54bebbcc5a884b22c089c(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:56:12,668 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:12,668 INFO [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675965371820; duration=0sec 2023-02-09 17:56:12,669 DEBUG [RS:0;jenkins-hbase4:42581-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 17:56:12,674 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130bd126065bc7d45e0b24099df2140c1c1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130bd126065bc7d45e0b24099df2140c1c1 2023-02-09 17:56:12,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:12,690 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:12,690 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:12,697 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/23093eb4e2164bfa992922fce3e9a37e first=Optional[r00] last=Optional[r8] 2023-02-09 17:56:12,697 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/23093eb4e2164bfa992922fce3e9a37e}] 2023-02-09 17:56:12,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/23093eb4e2164bfa992922fce3e9a37e for inclusion in 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:12,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 17:56:12,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 17:56:12,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 6612fb614c1536599d8d0aed042fbe19: 2023-02-09 17:56:12,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/23093eb4e2164bfa992922fce3e9a37e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__39ihb8u0jr8i77fh265ji97nil3ghvuv5did17bd44a557eukjo55r32n42gevec/family1/23093eb4e2164bfa992922fce3e9a37e 2023-02-09 17:56:12,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__39ihb8u0jr8i77fh265ji97nil3ghvuv5did17bd44a557eukjo55r32n42gevec/family1/23093eb4e2164bfa992922fce3e9a37e as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/99c2b737caa941bc9dff493f256d56cb_SeqId_50_ 2023-02-09 17:56:12,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__39ihb8u0jr8i77fh265ji97nil3ghvuv5did17bd44a557eukjo55r32n42gevec/family1/23093eb4e2164bfa992922fce3e9a37e into 6612fb614c1536599d8d0aed042fbe19/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/99c2b737caa941bc9dff493f256d56cb_SeqId_50_ - updating store file list. 2023-02-09 17:56:12,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/99c2b737caa941bc9dff493f256d56cb_SeqId_50_ into 6612fb614c1536599d8d0aed042fbe19/family1 2023-02-09 17:56:12,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__39ihb8u0jr8i77fh265ji97nil3ghvuv5did17bd44a557eukjo55r32n42gevec/family1/23093eb4e2164bfa992922fce3e9a37e into 6612fb614c1536599d8d0aed042fbe19/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/99c2b737caa941bc9dff493f256d56cb_SeqId_50_) 2023-02-09 17:56:12,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMinorCompactionWithMonthlyPolicy__39ihb8u0jr8i77fh265ji97nil3ghvuv5did17bd44a557eukjo55r32n42gevec/family1/23093eb4e2164bfa992922fce3e9a37e 2023-02-09 17:56:12,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:12,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:12,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c48041eaa19646e194cd26390dd4a2f3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c48041eaa19646e194cd26390dd4a2f3 2023-02-09 17:56:12,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283e0c836009144a00b5a2824f37d32319 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511283e0c836009144a00b5a2824f37d32319 2023-02-09 17:56:12,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba45fc02cb92418397b9251833c3209c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba45fc02cb92418397b9251833c3209c 2023-02-09 17:56:12,712 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 17:56:12,712 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 17:56:12,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:12,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:12,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 17:56:12,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 17:56:12,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:56:12,714 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 17:56:12,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.6920 sec 2023-02-09 17:56:12,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/296d396e4413461c8191373edb65e5c1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_] to archive 2023-02-09 17:56:12,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:12,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/7ed6bcf6b9814f82b9a26f5f3cda145a 2023-02-09 17:56:12,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/296d396e4413461c8191373edb65e5c1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/296d396e4413461c8191373edb65e5c1 2023-02-09 17:56:12,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_ to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/family1/dedd581b37cd47dd9a6ff18e6ce0f550_SeqId_47_ 2023-02-09 17:56:12,926 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254 (was 252) - Thread LEAK? -, OpenFileDescriptor=635 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 221), ProcessCount=168 (was 168), AvailableMemoryMB=3212 (was 3298) 2023-02-09 17:56:12,939 INFO [Listener at localhost/44673] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=254, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=168, AvailableMemoryMB=3212 2023-02-09 17:56:12,968 DEBUG [Listener at localhost/44673] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-09 17:56:12,991 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:12,991 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:13,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 17:56:13,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-09 17:56:13,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 17:56:13,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-09 17:56:13,025 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:13,025 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:13,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 17:56:13,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:13,027 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:13,031 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d empty. 2023-02-09 17:56:13,031 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:13,031 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:13,032 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:13,032 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326 empty. 2023-02-09 17:56:13,032 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936 empty. 2023-02-09 17:56:13,032 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:13,032 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:13,032 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-09 17:56:13,126 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:13,126 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:13,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:13,328 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:13,328 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:13,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:13,441 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-09 17:56:13,443 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 927e556cd631a9154b142f09a0d57936, NAME => 'testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:56:13,443 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => cebe7f0096a81b1857cdd89be052134d, NAME => 'testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:56:13,443 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5e725b7e0a7a2c1d7c2c8a6f80557326, NAME => 'testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/.tmp 2023-02-09 17:56:13,629 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:13,629 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:13,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing cebe7f0096a81b1857cdd89be052134d, disabling compactions & flushes 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 927e556cd631a9154b142f09a0d57936, disabling compactions & flushes 2023-02-09 17:56:13,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:13,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. after waiting 0 ms 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:13,854 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 5e725b7e0a7a2c1d7c2c8a6f80557326, disabling compactions & flushes 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. after waiting 0 ms 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:13,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:13,855 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for cebe7f0096a81b1857cdd89be052134d: Waiting for close lock at 1675965373854Disabling compacts and flushes for region at 1675965373854Disabling writes for close at 1675965373854Writing region close event to WAL at 1675965373854Closed at 1675965373854 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 927e556cd631a9154b142f09a0d57936: Waiting for close lock at 1675965373854Disabling compacts and flushes for region at 1675965373854Disabling writes for close at 1675965373855 (+1 ms)Writing region close event to WAL at 1675965373855Closed at 1675965373855 2023-02-09 17:56:13,855 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. after waiting 0 ms 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:13,855 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:13,855 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: Waiting for close lock at 1675965373855Disabling compacts and flushes for region at 1675965373855Disabling writes for close at 1675965373855Writing region close event to WAL at 1675965373855Closed at 1675965373855 2023-02-09 17:56:13,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 17:56:13,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965373858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965373858"}]},"ts":"1675965373858"} 2023-02-09 17:56:13,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965373858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965373858"}]},"ts":"1675965373858"} 2023-02-09 17:56:13,858 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675965373858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675965373858"}]},"ts":"1675965373858"} 2023-02-09 17:56:13,860 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 17:56:13,861 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 17:56:13,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965373861"}]},"ts":"1675965373861"} 2023-02-09 17:56:13,862 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-09 17:56:13,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cebe7f0096a81b1857cdd89be052134d, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5e725b7e0a7a2c1d7c2c8a6f80557326, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=927e556cd631a9154b142f09a0d57936, ASSIGN}] 2023-02-09 17:56:13,866 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5e725b7e0a7a2c1d7c2c8a6f80557326, ASSIGN 2023-02-09 17:56:13,866 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=927e556cd631a9154b142f09a0d57936, ASSIGN 2023-02-09 17:56:13,866 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cebe7f0096a81b1857cdd89be052134d, ASSIGN 2023-02-09 17:56:13,866 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5e725b7e0a7a2c1d7c2c8a6f80557326, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:56:13,866 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=927e556cd631a9154b142f09a0d57936, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:56:13,866 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cebe7f0096a81b1857cdd89be052134d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42581,1675965218218; forceNewPlan=false, retain=false 2023-02-09 17:56:14,018 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5e725b7e0a7a2c1d7c2c8a6f80557326, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=927e556cd631a9154b142f09a0d57936, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,018 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675965374018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965374018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965374018"}]},"ts":"1675965374018"} 2023-02-09 17:56:14,018 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=cebe7f0096a81b1857cdd89be052134d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965374018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965374018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965374018"}]},"ts":"1675965374018"} 2023-02-09 17:56:14,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965374018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675965374018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675965374018"}]},"ts":"1675965374018"} 2023-02-09 17:56:14,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 5e725b7e0a7a2c1d7c2c8a6f80557326, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:56:14,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure cebe7f0096a81b1857cdd89be052134d, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:56:14,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 927e556cd631a9154b142f09a0d57936, server=jenkins-hbase4.apache.org,42581,1675965218218}] 2023-02-09 17:56:14,130 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:14,130 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:14,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:14,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:14,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5e725b7e0a7a2c1d7c2c8a6f80557326, NAME => 'testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 17:56:14,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:14,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,196 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,197 DEBUG [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1 2023-02-09 17:56:14,197 DEBUG [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1 2023-02-09 17:56:14,198 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e725b7e0a7a2c1d7c2c8a6f80557326 columnFamilyName family1 2023-02-09 17:56:14,199 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] regionserver.HStore(310): Store=5e725b7e0a7a2c1d7c2c8a6f80557326/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,199 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,200 DEBUG [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2 2023-02-09 17:56:14,200 DEBUG [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2 2023-02-09 17:56:14,200 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e725b7e0a7a2c1d7c2c8a6f80557326 columnFamilyName family2 2023-02-09 17:56:14,201 INFO [StoreOpener-5e725b7e0a7a2c1d7c2c8a6f80557326-1] regionserver.HStore(310): Store=5e725b7e0a7a2c1d7c2c8a6f80557326/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:56:14,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:14,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:56:14,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5e725b7e0a7a2c1d7c2c8a6f80557326; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69573913, jitterRate=0.03673209249973297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:56:14,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: Running coprocessor pre-open hook at 1675965374175Writing region info on filesystem at 1675965374175Initializing all the Stores at 1675965374176 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374176Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374176Cleaning up temporary data from old regions at 1675965374202 (+26 ms)Cleaning up detritus from prior splits at 1675965374203 (+1 ms)Running coprocessor post-open hooks at 1675965374206 (+3 ms)Region opened successfully at 1675965374206 2023-02-09 17:56:14,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326., pid=120, masterSystemTime=1675965374172 2023-02-09 17:56:14,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:14,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:14,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:14,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cebe7f0096a81b1857cdd89be052134d, NAME => 'testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 17:56:14,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=5e725b7e0a7a2c1d7c2c8a6f80557326, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:14,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675965374208"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965374208"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965374208"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965374208"}]},"ts":"1675965374208"} 2023-02-09 17:56:14,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-02-09 17:56:14,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 5e725b7e0a7a2c1d7c2c8a6f80557326, server=jenkins-hbase4.apache.org,42581,1675965218218 in 189 msec 2023-02-09 17:56:14,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5e725b7e0a7a2c1d7c2c8a6f80557326, ASSIGN in 346 msec 2023-02-09 17:56:14,228 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,230 DEBUG [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1 2023-02-09 17:56:14,230 DEBUG [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1 2023-02-09 17:56:14,230 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cebe7f0096a81b1857cdd89be052134d columnFamilyName family1 2023-02-09 17:56:14,231 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] regionserver.HStore(310): Store=cebe7f0096a81b1857cdd89be052134d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,231 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,232 DEBUG [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2 2023-02-09 17:56:14,232 DEBUG [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2 2023-02-09 17:56:14,232 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cebe7f0096a81b1857cdd89be052134d columnFamilyName family2 2023-02-09 17:56:14,233 INFO [StoreOpener-cebe7f0096a81b1857cdd89be052134d-1] regionserver.HStore(310): Store=cebe7f0096a81b1857cdd89be052134d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:56:14,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:14,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:56:14,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cebe7f0096a81b1857cdd89be052134d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69456912, jitterRate=0.0349886417388916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:56:14,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cebe7f0096a81b1857cdd89be052134d: Running coprocessor pre-open hook at 1675965374208Writing region info on filesystem at 1675965374208Initializing all the Stores at 1675965374209 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374209Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374209Cleaning up temporary data from old regions at 1675965374234 (+25 ms)Cleaning up detritus from prior splits at 1675965374234Running coprocessor post-open hooks at 1675965374237 (+3 ms)Region opened successfully at 1675965374237 2023-02-09 17:56:14,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d., pid=121, masterSystemTime=1675965374172 2023-02-09 17:56:14,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:14,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:14,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:14,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 927e556cd631a9154b142f09a0d57936, NAME => 'testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 17:56:14,240 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=cebe7f0096a81b1857cdd89be052134d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,240 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965374240"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965374240"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965374240"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965374240"}]},"ts":"1675965374240"} 2023-02-09 17:56:14,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 17:56:14,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-02-09 17:56:14,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure cebe7f0096a81b1857cdd89be052134d, server=jenkins-hbase4.apache.org,42581,1675965218218 in 220 msec 2023-02-09 17:56:14,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cebe7f0096a81b1857cdd89be052134d, ASSIGN in 378 msec 2023-02-09 17:56:14,261 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,262 DEBUG [StoreOpener-927e556cd631a9154b142f09a0d57936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1 2023-02-09 17:56:14,262 DEBUG [StoreOpener-927e556cd631a9154b142f09a0d57936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1 2023-02-09 17:56:14,262 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 927e556cd631a9154b142f09a0d57936 columnFamilyName family1 2023-02-09 17:56:14,263 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] regionserver.HStore(310): Store=927e556cd631a9154b142f09a0d57936/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,263 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,264 DEBUG [StoreOpener-927e556cd631a9154b142f09a0d57936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2 2023-02-09 17:56:14,264 DEBUG [StoreOpener-927e556cd631a9154b142f09a0d57936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2 2023-02-09 17:56:14,265 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 927e556cd631a9154b142f09a0d57936 columnFamilyName family2 2023-02-09 17:56:14,265 INFO [StoreOpener-927e556cd631a9154b142f09a0d57936-1] regionserver.HStore(310): Store=927e556cd631a9154b142f09a0d57936/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 17:56:14,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 17:56:14,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:14,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 17:56:14,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 927e556cd631a9154b142f09a0d57936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65613249, jitterRate=-0.022286400198936462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 17:56:14,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 927e556cd631a9154b142f09a0d57936: Running coprocessor pre-open hook at 1675965374240Writing region info on filesystem at 1675965374240Initializing all the Stores at 1675965374241 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374241Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675965374241Cleaning up temporary data from old regions at 1675965374266 (+25 ms)Cleaning up detritus from prior splits at 1675965374267 (+1 ms)Running coprocessor post-open hooks at 1675965374269 (+2 ms)Region opened successfully at 1675965374269 2023-02-09 17:56:14,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936., pid=122, masterSystemTime=1675965374172 2023-02-09 17:56:14,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:14,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:14,271 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=927e556cd631a9154b142f09a0d57936, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:14,272 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675965374271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675965374271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675965374271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675965374271"}]},"ts":"1675965374271"} 2023-02-09 17:56:14,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-09 17:56:14,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 927e556cd631a9154b142f09a0d57936, server=jenkins-hbase4.apache.org,42581,1675965218218 in 251 msec 2023-02-09 17:56:14,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-09 17:56:14,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=927e556cd631a9154b142f09a0d57936, ASSIGN in 409 msec 2023-02-09 17:56:14,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 17:56:14,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675965374275"}]},"ts":"1675965374275"} 2023-02-09 17:56:14,276 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-09 17:56:14,278 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 17:56:14,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2560 sec 2023-02-09 17:56:15,131 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:15,131 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:15,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 17:56:15,132 INFO [Listener at localhost/44673] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-09 17:56:15,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:15,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:15,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:15,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:15,139 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:15,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:15,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 17:56:15,141 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 17:56:15,141 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:15,141 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 17:56:15,141 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 17:56:15,143 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:15,143 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:15,148 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:15,148 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:15,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:15,148 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:15,148 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:15,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:15,149 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 17:56:15,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 17:56:15,149 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 17:56:15,149 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:15,149 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:15,150 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:15,150 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. started... 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. started... 2023-02-09 17:56:15,150 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. started... 2023-02-09 17:56:15,152 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cebe7f0096a81b1857cdd89be052134d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:56:15,152 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5e725b7e0a7a2c1d7c2c8a6f80557326 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:56:15,152 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 927e556cd631a9154b142f09a0d57936 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 17:56:15,202 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091e6c43a008d94ba6a56500eeb0d09dab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091e6c43a008d94ba6a56500eeb0d09dab 2023-02-09 17:56:15,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020997d31ab32af94a4e947116c4e60c7de7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020997d31ab32af94a4e947116c4e60c7de7 2023-02-09 17:56:15,612 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209c0e728dab8994bbf84161306ac5352fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c0e728dab8994bbf84161306ac5352fb 2023-02-09 17:56:15,617 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/6e7126b6f2ac4a26a8913b560828d889 2023-02-09 17:56:15,748 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-09 17:56:16,020 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/7f8bca7367d64f95a60035a132dac77f 2023-02-09 17:56:16,027 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/8fd971bdde7c40ccbafa4b011791c10b 2023-02-09 17:56:16,050 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209cc8ed844a0b04b1ab01b09c1e7d26288 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc8ed844a0b04b1ab01b09c1e7d26288 2023-02-09 17:56:16,054 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/517f07f3d4574f7cad74f23a64f14691 2023-02-09 17:56:16,058 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/6e7126b6f2ac4a26a8913b560828d889 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889 2023-02-09 17:56:16,081 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 17:56:16,082 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/517f07f3d4574f7cad74f23a64f14691 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691 2023-02-09 17:56:16,086 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:56:16,086 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5e725b7e0a7a2c1d7c2c8a6f80557326 in 935ms, sequenceid=5, compaction requested=false 2023-02-09 17:56:16,087 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:16,087 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:16,087 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:56:16,454 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209d57bd434e0024ee28924692de8221069 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209d57bd434e0024ee28924692de8221069 2023-02-09 17:56:16,472 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209e2df8f8849bd45a789b5dcff6b1337b5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209e2df8f8849bd45a789b5dcff6b1337b5 2023-02-09 17:56:16,859 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/b601b2280556456ea9bc92913b73bfb8 2023-02-09 17:56:16,863 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/7f8bca7367d64f95a60035a132dac77f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f 2023-02-09 17:56:16,876 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/bc28fb8079134f729bfda8a2f04605a3 2023-02-09 17:56:16,880 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/8fd971bdde7c40ccbafa4b011791c10b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b 2023-02-09 17:56:16,887 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 17:56:16,887 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/b601b2280556456ea9bc92913b73bfb8 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8 2023-02-09 17:56:16,891 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:56:16,892 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cebe7f0096a81b1857cdd89be052134d in 1741ms, sequenceid=5, compaction requested=false 2023-02-09 17:56:16,892 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:16,892 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:16,892 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:56:16,904 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 17:56:16,904 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/bc28fb8079134f729bfda8a2f04605a3 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3 2023-02-09 17:56:16,907 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 17:56:16,908 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 927e556cd631a9154b142f09a0d57936 in 1756ms, sequenceid=5, compaction requested=false 2023-02-09 17:56:16,908 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:16,908 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:56:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:56:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 17:56:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 17:56:16,910 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:16,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 17:56:16,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49b6ea74[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:16,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 17:56:16,912 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,913 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,913 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,913 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:16,913 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 17:56:16,913 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 17:56:16,913 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 17:56:16,914 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:16,915 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:16,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 17:56:16,917 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 17:56:16,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:16,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:16,917 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 17:56:16,917 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:16,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:16,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,919 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:16,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:16,920 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,921 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:16,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:16,923 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:16,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 17:56:16,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 17:56:16,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:16,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:16,923 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:16,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:16,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:16,924 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:17,024 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:17,024 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:17,024 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:17,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:17,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:17,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:17,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:17,028 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:17,028 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:17,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 17:56:17,031 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 17:56:17,031 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:17,031 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 17:56:17,031 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 17:56:17,032 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:17,032 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:17,033 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:17,033 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:17,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:17,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:17,033 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:17,033 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:17,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:17,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:17,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:17,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:17,034 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 17:56:17,034 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 17:56:17,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 17:56:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 17:56:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 17:56:17,035 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:17,035 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. started... 2023-02-09 17:56:17,035 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5e725b7e0a7a2c1d7c2c8a6f80557326 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:56:17,035 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:56:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:17,036 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:17,035 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. started... 2023-02-09 17:56:17,036 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. started... 2023-02-09 17:56:17,036 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 927e556cd631a9154b142f09a0d57936 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:56:17,036 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cebe7f0096a81b1857cdd89be052134d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 17:56:17,086 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302094c2f0f53aad54ebba18466d78d5203fc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302094c2f0f53aad54ebba18466d78d5203fc 2023-02-09 17:56:17,096 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209926ac30722e24b9e8fe88988d31098c2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209926ac30722e24b9e8fe88988d31098c2 2023-02-09 17:56:17,482 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020919dbe867a7e0417da8378bd2f92bd083 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020919dbe867a7e0417da8378bd2f92bd083 2023-02-09 17:56:17,501 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/77bfab1053254214b96fe62c73bf9df7 2023-02-09 17:56:17,513 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/71498bc9dfe34d5792839bd93ea31610 2023-02-09 17:56:17,537 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020933669407b0774e0f979ed240366d66ba to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023020933669407b0774e0f979ed240366d66ba 2023-02-09 17:56:17,552 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093eb218cd0e294cf39814db7c8f10b6a5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302093eb218cd0e294cf39814db7c8f10b6a5 2023-02-09 17:56:17,561 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/f057cac4759e476384b0fe2d3a3de5cf 2023-02-09 17:56:17,565 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/71498bc9dfe34d5792839bd93ea31610 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610 2023-02-09 17:56:17,599 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 17:56:17,600 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/f057cac4759e476384b0fe2d3a3de5cf as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf 2023-02-09 17:56:17,604 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:56:17,605 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 927e556cd631a9154b142f09a0d57936 in 569ms, sequenceid=9, compaction requested=false 2023-02-09 17:56:17,606 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:17,606 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:17,606 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:56:17,896 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/8362b700ab7b416993f591b6a6feb566 2023-02-09 17:56:17,948 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/17281e893cb049e88eeae757688d8397 2023-02-09 17:56:17,951 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/77bfab1053254214b96fe62c73bf9df7 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7 2023-02-09 17:56:17,974 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 17:56:17,975 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/17281e893cb049e88eeae757688d8397 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397 2023-02-09 17:56:17,978 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:56:17,979 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cebe7f0096a81b1857cdd89be052134d in 943ms, sequenceid=9, compaction requested=false 2023-02-09 17:56:17,979 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:17,979 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:56:18,328 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302099fbf9abb09a44421adc83a35ec5f8c27 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302099fbf9abb09a44421adc83a35ec5f8c27 2023-02-09 17:56:18,732 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/9b417d02a63e4206b4bb3779c0d6429b 2023-02-09 17:56:18,736 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/8362b700ab7b416993f591b6a6feb566 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566 2023-02-09 17:56:18,766 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 17:56:18,767 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/9b417d02a63e4206b4bb3779c0d6429b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b 2023-02-09 17:56:18,770 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 17:56:18,771 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5e725b7e0a7a2c1d7c2c8a6f80557326 in 1736ms, sequenceid=9, compaction requested=false 2023-02-09 17:56:18,771 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:18,771 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:18,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:56:18,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:56:18,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 17:56:18,771 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 17:56:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,773 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:18,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 17:56:18,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75276d53[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:18,775 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 17:56:18,775 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,779 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,779 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,779 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 17:56:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 17:56:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 17:56:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:18,781 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:18,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 17:56:18,783 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 17:56:18,783 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:18,783 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:18,783 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 17:56:18,783 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:18,785 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,785 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,785 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:18,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:18,785 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,786 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,788 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:18,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 17:56:18,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:18,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:18,788 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:18,789 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,789 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:18,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:18,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 17:56:18,789 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:18,889 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:18,889 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:18,889 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:18,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:18,891 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:18,891 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:18,892 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:18,893 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:18,893 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:18,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:18,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:18,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 17:56:18,896 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 17:56:18,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:18,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 17:56:18,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 17:56:18,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,896 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:18,899 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:18,899 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:18,899 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:18,899 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:18,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:18,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:18,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:18,900 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 17:56:18,900 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 17:56:18,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 17:56:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 17:56:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 17:56:18,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:18,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. started... 2023-02-09 17:56:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:56:18,900 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:18,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:18,900 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5e725b7e0a7a2c1d7c2c8a6f80557326 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:56:18,900 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:18,901 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. started... 2023-02-09 17:56:18,901 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. started... 2023-02-09 17:56:18,901 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cebe7f0096a81b1857cdd89be052134d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:56:18,901 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 927e556cd631a9154b142f09a0d57936 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 17:56:18,961 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209617c4b93ebcc4260a2bd7b3d93cceba0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209617c4b93ebcc4260a2bd7b3d93cceba0 2023-02-09 17:56:18,976 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/715b2b8aa538486ba48c6ba61b890409 2023-02-09 17:56:19,349 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097a84b71e61504bea920e5f34154e78f4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302097a84b71e61504bea920e5f34154e78f4 2023-02-09 17:56:19,360 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209537119dcee724259bca18e6b376785fd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209537119dcee724259bca18e6b376785fd 2023-02-09 17:56:19,382 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/aa7406adcbe44402abe5316a229db942 2023-02-09 17:56:19,410 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209103b91e7e51b4813b3b8c60acfe29a82 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209103b91e7e51b4813b3b8c60acfe29a82 2023-02-09 17:56:19,714 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 17:56:19,773 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/2bdf4f42bc574770a786c2f63c7bf459 2023-02-09 17:56:19,804 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209f543d988423c4bffbcfb6b182294e7c9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209f543d988423c4bffbcfb6b182294e7c9 2023-02-09 17:56:19,817 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/e82a0db575e04e09aa2762c545d0beae 2023-02-09 17:56:19,820 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302096e5a0f5a4e6443168352bea50eda3f43 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302096e5a0f5a4e6443168352bea50eda3f43 2023-02-09 17:56:19,821 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/715b2b8aa538486ba48c6ba61b890409 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409 2023-02-09 17:56:19,848 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 17:56:19,849 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/e82a0db575e04e09aa2762c545d0beae as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae 2023-02-09 17:56:19,853 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:56:19,854 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cebe7f0096a81b1857cdd89be052134d in 953ms, sequenceid=13, compaction requested=true 2023-02-09 17:56:19,854 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:19,854 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:56:20,212 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/8cdcb6ae7a5542258372a9b5c29676f9 2023-02-09 17:56:20,216 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/2bdf4f42bc574770a786c2f63c7bf459 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459 2023-02-09 17:56:20,237 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd 2023-02-09 17:56:20,238 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 17:56:20,238 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/8cdcb6ae7a5542258372a9b5c29676f9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9 2023-02-09 17:56:20,241 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/aa7406adcbe44402abe5316a229db942 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942 2023-02-09 17:56:20,242 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:56:20,243 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 927e556cd631a9154b142f09a0d57936 in 1342ms, sequenceid=13, compaction requested=true 2023-02-09 17:56:20,243 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:20,243 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:20,243 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:56:20,263 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 17:56:20,264 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd 2023-02-09 17:56:20,267 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 17:56:20,268 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5e725b7e0a7a2c1d7c2c8a6f80557326 in 1368ms, sequenceid=13, compaction requested=true 2023-02-09 17:56:20,268 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:20,268 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:56:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:56:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 17:56:20,268 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 17:56:20,270 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:20,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 17:56:20,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61c5edb8[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:20,271 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 17:56:20,272 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,273 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 17:56:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 17:56:20,273 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:20,273 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,273 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 17:56:20,274 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 17:56:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:20,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 17:56:20,276 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 17:56:20,276 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:20,276 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:20,276 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 17:56:20,276 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:20,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,279 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:20,279 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:20,281 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:20,283 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:20,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 17:56:20,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:20,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:20,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:20,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:20,283 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,383 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:20,384 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:20,384 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:20,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:20,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:20,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:20,386 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 17:56:20,388 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:20,388 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:20,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:20,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:20,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 17:56:20,390 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 17:56:20,390 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:20,391 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 17:56:20,391 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 17:56:20,391 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,391 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:20,395 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,395 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:20,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:20,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:20,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:20,396 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:20,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:20,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:20,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 17:56:20,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 17:56:20,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 17:56:20,397 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 17:56:20,397 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:20,397 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. started... 2023-02-09 17:56:20,397 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5e725b7e0a7a2c1d7c2c8a6f80557326 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:56:20,397 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:56:20,397 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. started... 2023-02-09 17:56:20,397 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. started... 2023-02-09 17:56:20,397 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cebe7f0096a81b1857cdd89be052134d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:56:20,397 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 927e556cd631a9154b142f09a0d57936 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 17:56:20,852 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:56:20,852 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45f93e8d to 127.0.0.1:59572 2023-02-09 17:56:20,852 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:20,868 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209cb0970db3c7147f18c03b8fb968ceffb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209cb0970db3c7147f18c03b8fb968ceffb 2023-02-09 17:56:20,869 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b510918b84604f6d8199e64313a79c77 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209b510918b84604f6d8199e64313a79c77 2023-02-09 17:56:20,869 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302096b09bb6663b64493b8d0c6b9138305d3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302096b09bb6663b64493b8d0c6b9138305d3 2023-02-09 17:56:20,883 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/baf0ca5253f24c1e8c63e4d8f3308ab1 2023-02-09 17:56:20,889 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/983747501bae4188b09ef54e5b88499f 2023-02-09 17:56:20,915 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302095d69a92876804017861fd3bd821a24aa to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302095d69a92876804017861fd3bd821a24aa 2023-02-09 17:56:20,919 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/9a72769b663e498f906e6fae8606629c 2023-02-09 17:56:20,920 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209ddb35f071edc44bbbbdb463b4b3cf823 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209ddb35f071edc44bbbbdb463b4b3cf823 2023-02-09 17:56:20,922 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/baf0ca5253f24c1e8c63e4d8f3308ab1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1 2023-02-09 17:56:20,924 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/54630ac55951462685ab65da81dc45a5 2023-02-09 17:56:20,927 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/983747501bae4188b09ef54e5b88499f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f 2023-02-09 17:56:20,945 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 17:56:20,946 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/9a72769b663e498f906e6fae8606629c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c 2023-02-09 17:56:20,949 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:56:20,950 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cebe7f0096a81b1857cdd89be052134d in 553ms, sequenceid=17, compaction requested=true 2023-02-09 17:56:20,950 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:20,950 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:20,950 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:56:20,959 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 17:56:20,959 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/54630ac55951462685ab65da81dc45a5 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5 2023-02-09 17:56:20,964 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:56:20,965 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 927e556cd631a9154b142f09a0d57936 in 568ms, sequenceid=17, compaction requested=true 2023-02-09 17:56:20,965 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:20,965 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:20,965 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:56:21,283 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/0fdd634c9d2f42baa937144622d5a656 2023-02-09 17:56:21,319 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302097df576693e7e44f5aa927afac780c913 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302097df576693e7e44f5aa927afac780c913 2023-02-09 17:56:21,724 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/1b0bc17479d049caa1768e6725178610 2023-02-09 17:56:21,728 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/0fdd634c9d2f42baa937144622d5a656 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656 2023-02-09 17:56:21,751 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 17:56:21,752 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/1b0bc17479d049caa1768e6725178610 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610 2023-02-09 17:56:21,755 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 17:56:21,756 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5e725b7e0a7a2c1d7c2c8a6f80557326 in 1359ms, sequenceid=17, compaction requested=true 2023-02-09 17:56:21,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:21,756 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:21,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:56:21,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:56:21,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 17:56:21,756 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 17:56:21,758 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,758 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:21,758 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,758 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:21,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:21,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 17:56:21,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1f4ea5[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:21,760 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 17:56:21,760 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,761 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,761 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,761 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:21,761 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 17:56:21,761 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 17:56:21,761 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 17:56:21,762 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:21,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:21,762 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 17:56:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:21,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 17:56:21,764 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 17:56:21,764 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:21,764 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:21,764 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 17:56:21,764 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:21,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:21,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,767 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:21,767 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:21,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,768 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:21,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:21,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:21,770 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:21,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:21,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:21,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 17:56:21,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,770 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:21,771 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:21,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:21,771 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:21,771 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:21,871 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:21,871 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:21,871 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:21,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:21,881 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:21,889 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:21,897 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:21,898 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:21,980 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:21,980 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:21,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 17:56:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 17:56:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 17:56:21,983 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 17:56:21,983 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:21,983 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 17:56:21,983 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 17:56:21,983 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,983 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:21,985 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:21,985 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:21,985 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:21,985 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:21,985 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 17:56:21,986 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 17:56:21,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 17:56:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 17:56:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 17:56:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. started... 2023-02-09 17:56:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. started... 2023-02-09 17:56:21,986 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. started... 2023-02-09 17:56:21,986 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5e725b7e0a7a2c1d7c2c8a6f80557326 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:56:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 17:56:21,986 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cebe7f0096a81b1857cdd89be052134d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:56:21,986 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 927e556cd631a9154b142f09a0d57936 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 17:56:22,426 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/45e92223a7ad4884b08305760497b83c 2023-02-09 17:56:22,432 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/403a9f45f0f649f2a7f8b42425765b01 2023-02-09 17:56:22,449 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45e92223a7ad4884b08305760497b83c 2023-02-09 17:56:22,456 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 403a9f45f0f649f2a7f8b42425765b01 2023-02-09 17:56:22,826 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/378bb2114e324f3996c77148defba021 2023-02-09 17:56:22,850 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 378bb2114e324f3996c77148defba021 2023-02-09 17:56:23,269 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/c3b766f7503f4eaf9c706beec795ab9c 2023-02-09 17:56:23,272 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3b766f7503f4eaf9c706beec795ab9c 2023-02-09 17:56:23,272 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/45e92223a7ad4884b08305760497b83c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c 2023-02-09 17:56:23,278 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/089e96f6bda7437ea3d6812679e2ad04 2023-02-09 17:56:23,280 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 089e96f6bda7437ea3d6812679e2ad04 2023-02-09 17:56:23,281 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/403a9f45f0f649f2a7f8b42425765b01 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01 2023-02-09 17:56:23,295 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45e92223a7ad4884b08305760497b83c 2023-02-09 17:56:23,295 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 17:56:23,296 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/c3b766f7503f4eaf9c706beec795ab9c as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c 2023-02-09 17:56:23,302 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3b766f7503f4eaf9c706beec795ab9c 2023-02-09 17:56:23,303 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:56:23,303 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 927e556cd631a9154b142f09a0d57936 in 1317ms, sequenceid=23, compaction requested=true 2023-02-09 17:56:23,303 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:23,303 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:23,303 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 17:56:23,309 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 403a9f45f0f649f2a7f8b42425765b01 2023-02-09 17:56:23,309 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 17:56:23,310 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/089e96f6bda7437ea3d6812679e2ad04 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04 2023-02-09 17:56:23,313 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 089e96f6bda7437ea3d6812679e2ad04 2023-02-09 17:56:23,313 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:56:23,314 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5e725b7e0a7a2c1d7c2c8a6f80557326 in 1328ms, sequenceid=23, compaction requested=true 2023-02-09 17:56:23,314 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:23,314 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:23,314 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 17:56:23,661 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/29d250fe6a4d4cebab2d2fd59c81fd46 2023-02-09 17:56:23,665 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29d250fe6a4d4cebab2d2fd59c81fd46 2023-02-09 17:56:23,665 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/378bb2114e324f3996c77148defba021 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021 2023-02-09 17:56:23,687 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 378bb2114e324f3996c77148defba021 2023-02-09 17:56:23,687 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 17:56:23,688 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/29d250fe6a4d4cebab2d2fd59c81fd46 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46 2023-02-09 17:56:23,691 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29d250fe6a4d4cebab2d2fd59c81fd46 2023-02-09 17:56:23,691 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 17:56:23,692 INFO [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cebe7f0096a81b1857cdd89be052134d in 1706ms, sequenceid=23, compaction requested=true 2023-02-09 17:56:23,692 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:23,692 DEBUG [rs(jenkins-hbase4.apache.org,42581,1675965218218)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 17:56:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 17:56:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 17:56:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 17:56:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,694 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,694 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 17:56:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:23,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42581,1675965218218' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 17:56:23,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2584eaf8[Count = 0] remaining members to acquire global barrier 2023-02-09 17:56:23,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 17:56:23,695 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,698 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 17:56:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 17:56:23,698 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,698 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 17:56:23,698 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,42581,1675965218218' in zk 2023-02-09 17:56:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 17:56:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:23,699 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,42581,1675965218218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 17:56:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,42581,1675965218218': 2023-02-09 17:56:23,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42581,1675965218218' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 17:56:23,701 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 17:56:23,702 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 17:56:23,702 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 17:56:23,702 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 17:56:23,702 INFO [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 17:56:23,703 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,703 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 17:56:23,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,703 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 17:56:23,703 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:23,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,704 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 17:56:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 17:56:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:23,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 17:56:23,706 DEBUG [(jenkins-hbase4.apache.org,37293,1675965217092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 17:56:23,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 17:56:23,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 17:56:23,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 17:56:23,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 17:56:23,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 17:56:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 17:56:23,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 17:56:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 17:56:23,707 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 17:56:23,807 DEBUG [Listener at localhost/44673] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 17:56:23,808 INFO [Listener at localhost/44673] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:23,808 INFO [Listener at localhost/44673] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:23,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 17:56:23,809 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:23,809 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 is initiating major compaction (all files) 2023-02-09 17:56:23,809 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:23,809 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:23,809 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 in testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:23,809 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp, totalSize=27.1 K 2023-02-09 17:56:23,810 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 6e7126b6f2ac4a26a8913b560828d889, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375138 2023-02-09 17:56:23,810 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8362b700ab7b416993f591b6a6feb566, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:23,811 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting aa7406adcbe44402abe5316a229db942, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378891 2023-02-09 17:56:23,811 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 0fdd634c9d2f42baa937144622d5a656, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380386 2023-02-09 17:56:23,811 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 403a9f45f0f649f2a7f8b42425765b01, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:23,820 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 5e725b7e0a7a2c1d7c2c8a6f80557326#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:24,256 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del 2023-02-09 17:56:24,256 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del 2023-02-09 17:56:25,108 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9616cab7aa494494df7e70f4f782ab 2023-02-09 17:56:25,109 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family1/de9616cab7aa494494df7e70f4f782ab as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/de9616cab7aa494494df7e70f4f782ab 2023-02-09 17:56:25,130 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9616cab7aa494494df7e70f4f782ab 2023-02-09 17:56:25,131 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 of 5e725b7e0a7a2c1d7c2c8a6f80557326 into de9616cab7aa494494df7e70f4f782ab(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:56:25,132 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:25,132 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:25,132 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 5e725b7e0a7a2c1d7c2c8a6f80557326/family2 is initiating major compaction (all files) 2023-02-09 17:56:25,132 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:25,132 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:25,133 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 5e725b7e0a7a2c1d7c2c8a6f80557326/family2 in testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:25,133 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp, totalSize=25.4 K 2023-02-09 17:56:25,134 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 517f07f3d4574f7cad74f23a64f14691, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375138 2023-02-09 17:56:25,134 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 9b417d02a63e4206b4bb3779c0d6429b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:25,135 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 2e3b428c60ae4d2a80a467f0a5a1a0dd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378891 2023-02-09 17:56:25,135 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 1b0bc17479d049caa1768e6725178610, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380386 2023-02-09 17:56:25,135 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 089e96f6bda7437ea3d6812679e2ad04, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:25,144 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 5e725b7e0a7a2c1d7c2c8a6f80557326#family2#compaction#198 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:25,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01] to archive 2023-02-09 17:56:25,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:25,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/6e7126b6f2ac4a26a8913b560828d889 2023-02-09 17:56:25,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/8362b700ab7b416993f591b6a6feb566 2023-02-09 17:56:25,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/aa7406adcbe44402abe5316a229db942 2023-02-09 17:56:25,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/0fdd634c9d2f42baa937144622d5a656 2023-02-09 17:56:25,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/403a9f45f0f649f2a7f8b42425765b01 2023-02-09 17:56:25,555 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209b486443dc1404a18b12520e9aca15088_del 2023-02-09 17:56:25,555 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209b486443dc1404a18b12520e9aca15088_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209b486443dc1404a18b12520e9aca15088_del 2023-02-09 17:56:26,368 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d029b4821646318c2e15d96c3c2da9 2023-02-09 17:56:26,368 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/.tmp/family2/b4d029b4821646318c2e15d96c3c2da9 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/b4d029b4821646318c2e15d96c3c2da9 2023-02-09 17:56:26,371 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d029b4821646318c2e15d96c3c2da9 2023-02-09 17:56:26,372 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5e725b7e0a7a2c1d7c2c8a6f80557326/family2 of 5e725b7e0a7a2c1d7c2c8a6f80557326 into b4d029b4821646318c2e15d96c3c2da9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:56:26,372 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:26,372 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:26,372 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 927e556cd631a9154b142f09a0d57936/family1 is initiating major compaction (all files) 2023-02-09 17:56:26,373 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:26,373 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:26,373 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 927e556cd631a9154b142f09a0d57936/family1 in testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:26,373 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp, totalSize=27.1 K 2023-02-09 17:56:26,373 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8fd971bdde7c40ccbafa4b011791c10b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375138 2023-02-09 17:56:26,374 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 71498bc9dfe34d5792839bd93ea31610, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:26,374 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 2bdf4f42bc574770a786c2f63c7bf459, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378892 2023-02-09 17:56:26,374 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 983747501bae4188b09ef54e5b88499f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380386 2023-02-09 17:56:26,375 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 45e92223a7ad4884b08305760497b83c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:26,382 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 927e556cd631a9154b142f09a0d57936#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:26,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04] to archive 2023-02-09 17:56:26,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:26,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/517f07f3d4574f7cad74f23a64f14691 2023-02-09 17:56:26,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/9b417d02a63e4206b4bb3779c0d6429b 2023-02-09 17:56:26,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/2e3b428c60ae4d2a80a467f0a5a1a0dd 2023-02-09 17:56:26,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/1b0bc17479d049caa1768e6725178610 2023-02-09 17:56:26,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family2/089e96f6bda7437ea3d6812679e2ad04 2023-02-09 17:56:26,818 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del 2023-02-09 17:56:26,818 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del 2023-02-09 17:56:27,268 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90107433843246d8a8c02666016bac49 2023-02-09 17:56:27,269 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family1/90107433843246d8a8c02666016bac49 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/90107433843246d8a8c02666016bac49 2023-02-09 17:56:27,290 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90107433843246d8a8c02666016bac49 2023-02-09 17:56:27,291 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 927e556cd631a9154b142f09a0d57936/family1 of 927e556cd631a9154b142f09a0d57936 into 90107433843246d8a8c02666016bac49(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:56:27,291 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:27,291 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:27,291 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): 927e556cd631a9154b142f09a0d57936/family2 is initiating major compaction (all files) 2023-02-09 17:56:27,291 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:27,291 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:27,291 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of 927e556cd631a9154b142f09a0d57936/family2 in testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:27,291 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp, totalSize=25.4 K 2023-02-09 17:56:27,292 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting bc28fb8079134f729bfda8a2f04605a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375138 2023-02-09 17:56:27,292 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting f057cac4759e476384b0fe2d3a3de5cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:27,292 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 8cdcb6ae7a5542258372a9b5c29676f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378892 2023-02-09 17:56:27,293 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 54630ac55951462685ab65da81dc45a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380386 2023-02-09 17:56:27,293 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting c3b766f7503f4eaf9c706beec795ab9c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:27,306 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): 927e556cd631a9154b142f09a0d57936#family2#compaction#200 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:27,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c] to archive 2023-02-09 17:56:27,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:27,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/8fd971bdde7c40ccbafa4b011791c10b 2023-02-09 17:56:27,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/71498bc9dfe34d5792839bd93ea31610 2023-02-09 17:56:27,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/2bdf4f42bc574770a786c2f63c7bf459 2023-02-09 17:56:27,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/983747501bae4188b09ef54e5b88499f 2023-02-09 17:56:27,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/45e92223a7ad4884b08305760497b83c 2023-02-09 17:56:27,713 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209b0ebb20d4dd74d1bbff3f166a3efe297_del 2023-02-09 17:56:27,714 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b0ebb20d4dd74d1bbff3f166a3efe297_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209b0ebb20d4dd74d1bbff3f166a3efe297_del 2023-02-09 17:56:28,526 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26224a1f85ba42e691ac5f11f78a5aa0 2023-02-09 17:56:28,527 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/.tmp/family2/26224a1f85ba42e691ac5f11f78a5aa0 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/26224a1f85ba42e691ac5f11f78a5aa0 2023-02-09 17:56:28,530 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26224a1f85ba42e691ac5f11f78a5aa0 2023-02-09 17:56:28,531 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 927e556cd631a9154b142f09a0d57936/family2 of 927e556cd631a9154b142f09a0d57936 into 26224a1f85ba42e691ac5f11f78a5aa0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 17:56:28,531 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:28,531 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:28,531 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): cebe7f0096a81b1857cdd89be052134d/family1 is initiating major compaction (all files) 2023-02-09 17:56:28,531 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:28,531 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:28,532 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of cebe7f0096a81b1857cdd89be052134d/family1 in testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:28,532 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp, totalSize=27.1 K 2023-02-09 17:56:28,532 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 7f8bca7367d64f95a60035a132dac77f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375137 2023-02-09 17:56:28,533 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 77bfab1053254214b96fe62c73bf9df7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:28,533 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 715b2b8aa538486ba48c6ba61b890409, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378891 2023-02-09 17:56:28,533 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting baf0ca5253f24c1e8c63e4d8f3308ab1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380385 2023-02-09 17:56:28,534 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 378bb2114e324f3996c77148defba021, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:28,540 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): cebe7f0096a81b1857cdd89be052134d#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:28,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c] to archive 2023-02-09 17:56:28,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:28,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/bc28fb8079134f729bfda8a2f04605a3 2023-02-09 17:56:28,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/f057cac4759e476384b0fe2d3a3de5cf 2023-02-09 17:56:28,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/8cdcb6ae7a5542258372a9b5c29676f9 2023-02-09 17:56:28,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/54630ac55951462685ab65da81dc45a5 2023-02-09 17:56:28,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family2/c3b766f7503f4eaf9c706beec795ab9c 2023-02-09 17:56:28,577 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del 2023-02-09 17:56:28,577 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del 2023-02-09 17:56:29,427 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ed4a1698e2141b89593b84ce7d9592f 2023-02-09 17:56:29,428 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family1/4ed4a1698e2141b89593b84ce7d9592f as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/4ed4a1698e2141b89593b84ce7d9592f 2023-02-09 17:56:29,449 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ed4a1698e2141b89593b84ce7d9592f 2023-02-09 17:56:29,450 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cebe7f0096a81b1857cdd89be052134d/family1 of cebe7f0096a81b1857cdd89be052134d into 4ed4a1698e2141b89593b84ce7d9592f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:56:29,450 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:29,451 DEBUG [Listener at localhost/44673] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 17:56:29,451 DEBUG [Listener at localhost/44673] regionserver.HStore(1912): cebe7f0096a81b1857cdd89be052134d/family2 is initiating major compaction (all files) 2023-02-09 17:56:29,451 INFO [Listener at localhost/44673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 17:56:29,451 INFO [Listener at localhost/44673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 17:56:29,451 INFO [Listener at localhost/44673] regionserver.HRegion(2258): Starting compaction of cebe7f0096a81b1857cdd89be052134d/family2 in testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:29,451 INFO [Listener at localhost/44673] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46] into tmpdir=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp, totalSize=25.4 K 2023-02-09 17:56:29,451 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting b601b2280556456ea9bc92913b73bfb8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675965375137 2023-02-09 17:56:29,452 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 17281e893cb049e88eeae757688d8397, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675965377026 2023-02-09 17:56:29,452 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting e82a0db575e04e09aa2762c545d0beae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675965378891 2023-02-09 17:56:29,452 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 9a72769b663e498f906e6fae8606629c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675965380385 2023-02-09 17:56:29,453 DEBUG [Listener at localhost/44673] compactions.Compactor(207): Compacting 29d250fe6a4d4cebab2d2fd59c81fd46, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 17:56:29,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021] to archive 2023-02-09 17:56:29,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:29,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/7f8bca7367d64f95a60035a132dac77f 2023-02-09 17:56:29,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/77bfab1053254214b96fe62c73bf9df7 2023-02-09 17:56:29,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/715b2b8aa538486ba48c6ba61b890409 2023-02-09 17:56:29,460 INFO [Listener at localhost/44673] throttle.PressureAwareThroughputController(145): cebe7f0096a81b1857cdd89be052134d#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 17:56:29,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/baf0ca5253f24c1e8c63e4d8f3308ab1 2023-02-09 17:56:29,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/378bb2114e324f3996c77148defba021 2023-02-09 17:56:29,466 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020957e9caa3aaf44f1ba10748827bc8f0f2_del 2023-02-09 17:56:29,466 INFO [Listener at localhost/44673] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020957e9caa3aaf44f1ba10748827bc8f0f2_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023020957e9caa3aaf44f1ba10748827bc8f0f2_del 2023-02-09 17:56:30,279 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1e97a60d2f64a339a8e486f8dfecd5a 2023-02-09 17:56:30,279 DEBUG [Listener at localhost/44673] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/.tmp/family2/a1e97a60d2f64a339a8e486f8dfecd5a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/a1e97a60d2f64a339a8e486f8dfecd5a 2023-02-09 17:56:30,282 INFO [Listener at localhost/44673] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1e97a60d2f64a339a8e486f8dfecd5a 2023-02-09 17:56:30,283 INFO [Listener at localhost/44673] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cebe7f0096a81b1857cdd89be052134d/family2 of cebe7f0096a81b1857cdd89be052134d into a1e97a60d2f64a339a8e486f8dfecd5a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 17:56:30,283 DEBUG [Listener at localhost/44673] regionserver.HRegion(2288): Compaction status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:30,286 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:30,289 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:30,292 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:30,293 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:30,297 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x9D\xFF\xFE\x00\xDC \xEC\xEB\xFB\x87A\xD7\xC8\xA9qx"\x10\x88\xDD>E\x91\xFE\xC0IE6\xB0\xBF\xDF\xA6\x84\xBC*\x10|\x06\x8B\xAB\x9B\x8E\xD1v\xE5\xF55\x16\xBE\x80\xFFr2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-09 17:56:30,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 17:56:30,319 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 17:56:30,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:56:30,319 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675965990319 2023-02-09 17:56:30,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 17:56:30,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46] to archive 2023-02-09 17:56:30,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:30,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/b601b2280556456ea9bc92913b73bfb8 2023-02-09 17:56:30,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/17281e893cb049e88eeae757688d8397 2023-02-09 17:56:30,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/e82a0db575e04e09aa2762c545d0beae 2023-02-09 17:56:30,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/9a72769b663e498f906e6fae8606629c 2023-02-09 17:56:30,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family2/29d250fe6a4d4cebab2d2fd59c81fd46 2023-02-09 17:56:30,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-09 17:56:30,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del 2023-02-09 17:56:30,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del 2023-02-09 17:56:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del 2023-02-09 17:56:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:30,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] zookeeper.ReadOnlyZKClient(139): Connect 0x2a35e30a to 127.0.0.1:59572 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 17:56:30,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f728dfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 17:56:30,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:31,487 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 17:56:31,648 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094c08b349ee874ba69857af6807cbe37e to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302094c08b349ee874ba69857af6807cbe37e 2023-02-09 17:56:31,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:31,660 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 17:56:31,663 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 17:56:31,669 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:31,670 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:31,671 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 17:56:31,672 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 17:56:31,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/95cda6a53b0d45098a6e6f140b9b9a67 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 17:56:31,701 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/95cda6a53b0d45098a6e6f140b9b9a67}] 2023-02-09 17:56:31,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/95cda6a53b0d45098a6e6f140b9b9a67 for inclusion in 927e556cd631a9154b142f09a0d57936/family1 2023-02-09 17:56:31,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 17:56:31,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 17:56:31,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 927e556cd631a9154b142f09a0d57936: 2023-02-09 17:56:31,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/95cda6a53b0d45098a6e6f140b9b9a67 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__8h6iioum8dtfpvt6uddqtqha152jdop6oic4d06tfiq0p2npe1lcqmo8fk200mgb/family1/95cda6a53b0d45098a6e6f140b9b9a67 2023-02-09 17:56:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__8h6iioum8dtfpvt6uddqtqha152jdop6oic4d06tfiq0p2npe1lcqmo8fk200mgb/family1/95cda6a53b0d45098a6e6f140b9b9a67 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/3dec630b0b194830907bf9fdefedee9f_SeqId_28_ 2023-02-09 17:56:31,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__8h6iioum8dtfpvt6uddqtqha152jdop6oic4d06tfiq0p2npe1lcqmo8fk200mgb/family1/95cda6a53b0d45098a6e6f140b9b9a67 into 927e556cd631a9154b142f09a0d57936/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/3dec630b0b194830907bf9fdefedee9f_SeqId_28_ - updating store file list. 2023-02-09 17:56:31,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/3dec630b0b194830907bf9fdefedee9f_SeqId_28_ into 927e556cd631a9154b142f09a0d57936/family1 2023-02-09 17:56:31,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__8h6iioum8dtfpvt6uddqtqha152jdop6oic4d06tfiq0p2npe1lcqmo8fk200mgb/family1/95cda6a53b0d45098a6e6f140b9b9a67 into 927e556cd631a9154b142f09a0d57936/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/family1/3dec630b0b194830907bf9fdefedee9f_SeqId_28_) 2023-02-09 17:56:31,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__8h6iioum8dtfpvt6uddqtqha152jdop6oic4d06tfiq0p2npe1lcqmo8fk200mgb/family1/95cda6a53b0d45098a6e6f140b9b9a67 2023-02-09 17:56:31,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:31,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:31,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302097a84b71e61504bea920e5f34154e78f4 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302097a84b71e61504bea920e5f34154e78f4 2023-02-09 17:56:31,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209926ac30722e24b9e8fe88988d31098c2 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209926ac30722e24b9e8fe88988d31098c2 2023-02-09 17:56:31,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209b510918b84604f6d8199e64313a79c77 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209b510918b84604f6d8199e64313a79c77 2023-02-09 17:56:31,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c0e728dab8994bbf84161306ac5352fb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c0e728dab8994bbf84161306ac5352fb 2023-02-09 17:56:31,758 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 17:56:31,758 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 17:56:31,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:31,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:32,314 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302091adf9c49763a4b38b8b2d48a4f262b25 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302091adf9c49763a4b38b8b2d48a4f262b25 2023-02-09 17:56:32,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:32,335 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:32,336 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:32,362 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/17258c1ab04547adbb99ade12edd8b81 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 17:56:32,363 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/17258c1ab04547adbb99ade12edd8b81}] 2023-02-09 17:56:32,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/17258c1ab04547adbb99ade12edd8b81 for inclusion in cebe7f0096a81b1857cdd89be052134d/family1 2023-02-09 17:56:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 17:56:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 17:56:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for cebe7f0096a81b1857cdd89be052134d: 2023-02-09 17:56:32,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/17258c1ab04547adbb99ade12edd8b81 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__2rcru9fqmkng62h3rld7i7afvnh5j70fk26dcq8vrljo7s68ipf6ikm6mi04uap5/family1/17258c1ab04547adbb99ade12edd8b81 2023-02-09 17:56:32,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__2rcru9fqmkng62h3rld7i7afvnh5j70fk26dcq8vrljo7s68ipf6ikm6mi04uap5/family1/17258c1ab04547adbb99ade12edd8b81 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/259a7fb343c04c6aa05386df7ebf9517_SeqId_28_ 2023-02-09 17:56:32,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__2rcru9fqmkng62h3rld7i7afvnh5j70fk26dcq8vrljo7s68ipf6ikm6mi04uap5/family1/17258c1ab04547adbb99ade12edd8b81 into cebe7f0096a81b1857cdd89be052134d/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/259a7fb343c04c6aa05386df7ebf9517_SeqId_28_ - updating store file list. 2023-02-09 17:56:32,411 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/259a7fb343c04c6aa05386df7ebf9517_SeqId_28_ into cebe7f0096a81b1857cdd89be052134d/family1 2023-02-09 17:56:32,411 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__2rcru9fqmkng62h3rld7i7afvnh5j70fk26dcq8vrljo7s68ipf6ikm6mi04uap5/family1/17258c1ab04547adbb99ade12edd8b81 into cebe7f0096a81b1857cdd89be052134d/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/family1/259a7fb343c04c6aa05386df7ebf9517_SeqId_28_) 2023-02-09 17:56:32,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__2rcru9fqmkng62h3rld7i7afvnh5j70fk26dcq8vrljo7s68ipf6ikm6mi04uap5/family1/17258c1ab04547adbb99ade12edd8b81 2023-02-09 17:56:32,413 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:32,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:32,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302094c2f0f53aad54ebba18466d78d5203fc to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302094c2f0f53aad54ebba18466d78d5203fc 2023-02-09 17:56:32,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209617c4b93ebcc4260a2bd7b3d93cceba0 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209617c4b93ebcc4260a2bd7b3d93cceba0 2023-02-09 17:56:32,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302096b09bb6663b64493b8d0c6b9138305d3 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302096b09bb6663b64493b8d0c6b9138305d3 2023-02-09 17:56:32,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020997d31ab32af94a4e947116c4e60c7de7 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020997d31ab32af94a4e947116c4e60c7de7 2023-02-09 17:56:32,417 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 17:56:32,417 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 17:56:32,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:32,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:32,724 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 17:56:32,989 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020940868dea08bc43d286b0c5b83396cdb5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020940868dea08bc43d286b0c5b83396cdb5 2023-02-09 17:56:32,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:33,003 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 17:56:33,003 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 17:56:33,028 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/507dd355ce2041a79feb79fd269d4dc5 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 17:56:33,029 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326., hostname=jenkins-hbase4.apache.org,42581,1675965218218, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/507dd355ce2041a79feb79fd269d4dc5}] 2023-02-09 17:56:33,031 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(763): Validating hfile at hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/507dd355ce2041a79feb79fd269d4dc5 for inclusion in 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 2023-02-09 17:56:33,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 17:56:33,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 17:56:33,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegion(2445): Flush status journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: 2023-02-09 17:56:33,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/507dd355ce2041a79feb79fd269d4dc5 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__5s7erhl84fdvioh3rica2vg2ak1dvrm5ncafeh7jva6crijehcgrsskkoah2hvjm/family1/507dd355ce2041a79feb79fd269d4dc5 2023-02-09 17:56:33,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__5s7erhl84fdvioh3rica2vg2ak1dvrm5ncafeh7jva6crijehcgrsskkoah2hvjm/family1/507dd355ce2041a79feb79fd269d4dc5 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/14a12309280f4017b557eb745ad47bcf_SeqId_28_ 2023-02-09 17:56:33,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(849): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__5s7erhl84fdvioh3rica2vg2ak1dvrm5ncafeh7jva6crijehcgrsskkoah2hvjm/family1/507dd355ce2041a79feb79fd269d4dc5 into 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/14a12309280f4017b557eb745ad47bcf_SeqId_28_ - updating store file list. 2023-02-09 17:56:33,075 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(882): Loaded HFile hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/14a12309280f4017b557eb745ad47bcf_SeqId_28_ into 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 2023-02-09 17:56:33,075 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.HStore(855): Successfully loaded hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__5s7erhl84fdvioh3rica2vg2ak1dvrm5ncafeh7jva6crijehcgrsskkoah2hvjm/family1/507dd355ce2041a79feb79fd269d4dc5 into 5e725b7e0a7a2c1d7c2c8a6f80557326/family1 (new location: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/family1/14a12309280f4017b557eb745ad47bcf_SeqId_28_) 2023-02-09 17:56:33,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42581] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/staging/jenkins__testMajorCompactionFromAdmin__5s7erhl84fdvioh3rica2vg2ak1dvrm5ncafeh7jva6crijehcgrsskkoah2hvjm/family1/507dd355ce2041a79feb79fd269d4dc5 2023-02-09 17:56:33,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:33,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:33,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020919dbe867a7e0417da8378bd2f92bd083 to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020919dbe867a7e0417da8378bd2f92bd083 2023-02-09 17:56:33,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091e6c43a008d94ba6a56500eeb0d09dab to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091e6c43a008d94ba6a56500eeb0d09dab 2023-02-09 17:56:33,081 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209537119dcee724259bca18e6b376785fd to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209537119dcee724259bca18e6b376785fd 2023-02-09 17:56:33,082 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209cb0970db3c7147f18c03b8fb968ceffb to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209cb0970db3c7147f18c03b8fb968ceffb 2023-02-09 17:56:33,082 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 17:56:33,082 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 17:56:33,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:33,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 17:56:33,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 17:56:33,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del] 2023-02-09 17:56:33,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:33,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302091458dfa575d74fb1991f5badc5783ac0_del 2023-02-09 17:56:33,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 17:56:33,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del] 2023-02-09 17:56:33,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:33,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209173c7c3a83a746c7a2f4c404b3ed232e_del 2023-02-09 17:56:33,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 17:56:33,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del] 2023-02-09 17:56:33,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 17:56:33,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del to hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302095d99186d176b4807baecc12024eb988a_del 2023-02-09 17:56:33,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 17:56:33,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675965222152] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 17:56:33,088 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 17:56:33,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7710 sec 2023-02-09 17:56:33,101 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:33,103 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:33,106 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 17:56:33,107 DEBUG [Listener at localhost/44673] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 17:56:33,111 INFO [Listener at localhost/44673] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 17:56:33,144 INFO [Listener at localhost/44673] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 254), OpenFileDescriptor=641 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 210), ProcessCount=168 (was 168), AvailableMemoryMB=3202 (was 3212) 2023-02-09 17:56:33,144 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33fc1e18 to 127.0.0.1:59572 2023-02-09 17:56:33,145 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:33,145 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 17:56:33,145 INFO [Listener at localhost/44673] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 17:56:33,145 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0672b468 to 127.0.0.1:59572 2023-02-09 17:56:33,145 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:33,145 DEBUG [Listener at localhost/44673] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 17:56:33,145 DEBUG [Listener at localhost/44673] util.JVMClusterUtil(257): Found active master hash=1141152862, stopped=false 2023-02-09 17:56:33,145 INFO [Listener at localhost/44673] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:56:33,147 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 17:56:33,147 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:56:33,147 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 17:56:33,147 INFO [Listener at localhost/44673] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 17:56:33,147 DEBUG [Listener at localhost/44673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a13093 to 127.0.0.1:59572 2023-02-09 17:56:33,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 17:56:33,148 DEBUG [Listener at localhost/44673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:33,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 17:56:33,148 INFO [Listener at localhost/44673] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42581,1675965218218' ***** 2023-02-09 17:56:33,148 INFO [Listener at localhost/44673] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 17:56:33,148 INFO [RS:0;jenkins-hbase4:42581] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 17:56:33,148 INFO [RS:0;jenkins-hbase4:42581] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 17:56:33,148 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 17:56:33,148 INFO [RS:0;jenkins-hbase4:42581] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for b0fcebcd287c1ba929a1f12243ab2520 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 500e9a4f9dd5c96df34dcabea31a3dba 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 6f576a3c5dfc02b76d6036c8a466e70a 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 0d34b4f06061d789d27ca604cbf3df18 2023-02-09 17:56:33,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b0fcebcd287c1ba929a1f12243ab2520, disabling compactions & flushes 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 6612fb614c1536599d8d0aed042fbe19 2023-02-09 17:56:33,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for a046371abb5f5c08e5ab51af821baf0d 2023-02-09 17:56:33,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 5e725b7e0a7a2c1d7c2c8a6f80557326 2023-02-09 17:56:33,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. after waiting 0 ms 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 08df5076a8a74301ce9055f859f6894a 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:56:33,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:56:33,149 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for e87c0b70dc508223d272183bfbd0aa11 2023-02-09 17:56:33,149 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 22c96a7058603f23c359a3e3eedaad85 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for a2a95d2d23d1e33829f11de663dbf7e3 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 3a1038bc277a0f83bb0fe93be1831eb3 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 54752fc19d09f992050698d1229355c8 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for a146aafefac4ec158955298f90ae2a23 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 93ac8ace32e8f3a9264c731189dc6e71 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 36456c17f39bbdd84b3e92271a1ce067 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 927e556cd631a9154b142f09a0d57936 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for b307c18a0ccccb0a839219d40f4730e1 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for cebe7f0096a81b1857cdd89be052134d 2023-02-09 17:56:33,150 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:33,150 DEBUG [RS:0;jenkins-hbase4:42581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43be4382 to 127.0.0.1:59572 2023-02-09 17:56:33,150 DEBUG [RS:0;jenkins-hbase4:42581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:33,151 INFO [RS:0;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 17:56:33,151 INFO [RS:0;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 17:56:33,151 INFO [RS:0;jenkins-hbase4:42581] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 17:56:33,151 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 17:56:33,151 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-09 17:56:33,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 17:56:33,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 17:56:33,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 17:56:33,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 17:56:33,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 17:56:33,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-09 17:56:33,152 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 08df5076a8a74301ce9055f859f6894a, 0d34b4f06061d789d27ca604cbf3df18, 1588230740, 22c96a7058603f23c359a3e3eedaad85, 36456c17f39bbdd84b3e92271a1ce067, 3a1038bc277a0f83bb0fe93be1831eb3, 500e9a4f9dd5c96df34dcabea31a3dba, 54752fc19d09f992050698d1229355c8, 5e725b7e0a7a2c1d7c2c8a6f80557326, 6612fb614c1536599d8d0aed042fbe19, 6f576a3c5dfc02b76d6036c8a466e70a, 927e556cd631a9154b142f09a0d57936, 93ac8ace32e8f3a9264c731189dc6e71, a046371abb5f5c08e5ab51af821baf0d, a146aafefac4ec158955298f90ae2a23, a2a95d2d23d1e33829f11de663dbf7e3, b0fcebcd287c1ba929a1f12243ab2520, b307c18a0ccccb0a839219d40f4730e1, cebe7f0096a81b1857cdd89be052134d, e87c0b70dc508223d272183bfbd0aa11, e9b77e263bf3d508cc45bcbf015afb9f 2023-02-09 17:56:33,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/b0fcebcd287c1ba929a1f12243ab2520/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b0fcebcd287c1ba929a1f12243ab2520: Waiting for close lock at 1675965393149Running coprocessor pre-close hooks at 1675965393149Disabling compacts and flushes for region at 1675965393149Disabling writes for close at 1675965393149Writing region close event to WAL at 1675965393152 (+3 ms)Running coprocessor post-close hooks at 1675965393155 (+3 ms)Closed at 1675965393156 (+1 ms) 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675965343833.b0fcebcd287c1ba929a1f12243ab2520. 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 500e9a4f9dd5c96df34dcabea31a3dba, disabling compactions & flushes 2023-02-09 17:56:33,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. after waiting 0 ms 2023-02-09 17:56:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:56:33,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/500e9a4f9dd5c96df34dcabea31a3dba/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 17:56:33,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 500e9a4f9dd5c96df34dcabea31a3dba: Waiting for close lock at 1675965393156Running coprocessor pre-close hooks at 1675965393156Disabling compacts and flushes for region at 1675965393156Disabling writes for close at 1675965393156Writing region close event to WAL at 1675965393157 (+1 ms)Running coprocessor post-close hooks at 1675965393160 (+3 ms)Closed at 1675965393161 (+1 ms) 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675965222250.500e9a4f9dd5c96df34dcabea31a3dba. 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6f576a3c5dfc02b76d6036c8a466e70a, disabling compactions & flushes 2023-02-09 17:56:33,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. after waiting 0 ms 2023-02-09 17:56:33,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:56:33,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/info/354b3a4d86094617a02f56d6522b4ffb 2023-02-09 17:56:33,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/6f576a3c5dfc02b76d6036c8a466e70a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 17:56:33,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6f576a3c5dfc02b76d6036c8a466e70a: Waiting for close lock at 1675965393161Running coprocessor pre-close hooks at 1675965393161Disabling compacts and flushes for region at 1675965393161Disabling writes for close at 1675965393161Writing region close event to WAL at 1675965393161Running coprocessor post-close hooks at 1675965393164 (+3 ms)Closed at 1675965393164 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675965260006.6f576a3c5dfc02b76d6036c8a466e70a. 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d34b4f06061d789d27ca604cbf3df18, disabling compactions & flushes 2023-02-09 17:56:33,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. after waiting 0 ms 2023-02-09 17:56:33,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:56:33,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 354b3a4d86094617a02f56d6522b4ffb 2023-02-09 17:56:33,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithMonthlyPolicy/0d34b4f06061d789d27ca604cbf3df18/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 17:56:33,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d34b4f06061d789d27ca604cbf3df18: Waiting for close lock at 1675965393164Running coprocessor pre-close hooks at 1675965393164Disabling compacts and flushes for region at 1675965393164Disabling writes for close at 1675965393164Writing region close event to WAL at 1675965393165 (+1 ms)Running coprocessor post-close hooks at 1675965393167 (+2 ms)Closed at 1675965393168 (+1 ms) 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675965237267.0d34b4f06061d789d27ca604cbf3df18. 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6612fb614c1536599d8d0aed042fbe19, disabling compactions & flushes 2023-02-09 17:56:33,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. after waiting 0 ms 2023-02-09 17:56:33,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:33,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithMonthlyPolicy/6612fb614c1536599d8d0aed042fbe19/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 17:56:33,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6612fb614c1536599d8d0aed042fbe19: Waiting for close lock at 1675965393168Running coprocessor pre-close hooks at 1675965393168Disabling compacts and flushes for region at 1675965393168Disabling writes for close at 1675965393168Writing region close event to WAL at 1675965393169 (+1 ms)Running coprocessor post-close hooks at 1675965393171 (+2 ms)Closed at 1675965393172 (+1 ms) 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675965359528.6612fb614c1536599d8d0aed042fbe19. 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a046371abb5f5c08e5ab51af821baf0d, disabling compactions & flushes 2023-02-09 17:56:33,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. after waiting 0 ms 2023-02-09 17:56:33,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:56:33,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/a046371abb5f5c08e5ab51af821baf0d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 17:56:33,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:56:33,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a046371abb5f5c08e5ab51af821baf0d: Waiting for close lock at 1675965393172Running coprocessor pre-close hooks at 1675965393172Disabling compacts and flushes for region at 1675965393172Disabling writes for close at 1675965393172Writing region close event to WAL at 1675965393173 (+1 ms)Running coprocessor post-close hooks at 1675965393175 (+2 ms)Closed at 1675965393175 2023-02-09 17:56:33,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675965260006.a046371abb5f5c08e5ab51af821baf0d. 2023-02-09 17:56:33,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5e725b7e0a7a2c1d7c2c8a6f80557326, disabling compactions & flushes 2023-02-09 17:56:33,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:33,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:33,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. after waiting 0 ms 2023-02-09 17:56:33,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:33,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/5e725b7e0a7a2c1d7c2c8a6f80557326/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5e725b7e0a7a2c1d7c2c8a6f80557326: Waiting for close lock at 1675965393176Running coprocessor pre-close hooks at 1675965393176Disabling compacts and flushes for region at 1675965393176Disabling writes for close at 1675965393176Writing region close event to WAL at 1675965393177 (+1 ms)Running coprocessor post-close hooks at 1675965393179 (+2 ms)Closed at 1675965393179 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675965372992.5e725b7e0a7a2c1d7c2c8a6f80557326. 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08df5076a8a74301ce9055f859f6894a, disabling compactions & flushes 2023-02-09 17:56:33,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. after waiting 0 ms 2023-02-09 17:56:33,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:56:33,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testScannerOnBulkLoadRefHFiles/08df5076a8a74301ce9055f859f6894a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 17:56:33,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:56:33,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08df5076a8a74301ce9055f859f6894a: Waiting for close lock at 1675965393179Running coprocessor pre-close hooks at 1675965393179Disabling compacts and flushes for region at 1675965393179Disabling writes for close at 1675965393179Writing region close event to WAL at 1675965393180 (+1 ms)Running coprocessor post-close hooks at 1675965393182 (+2 ms)Closed at 1675965393182 2023-02-09 17:56:33,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675965260006.08df5076a8a74301ce9055f859f6894a. 2023-02-09 17:56:33,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9b77e263bf3d508cc45bcbf015afb9f, disabling compactions & flushes 2023-02-09 17:56:33,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:56:33,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:56:33,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. after waiting 0 ms 2023-02-09 17:56:33,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:56:33,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/e9b77e263bf3d508cc45bcbf015afb9f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 17:56:33,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9b77e263bf3d508cc45bcbf015afb9f: Waiting for close lock at 1675965393182Running coprocessor pre-close hooks at 1675965393182Disabling compacts and flushes for region at 1675965393182Disabling writes for close at 1675965393183 (+1 ms)Writing region close event to WAL at 1675965393183Running coprocessor post-close hooks at 1675965393186 (+3 ms)Closed at 1675965393186 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675965314994.e9b77e263bf3d508cc45bcbf015afb9f. 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e87c0b70dc508223d272183bfbd0aa11, disabling compactions & flushes 2023-02-09 17:56:33,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. after waiting 0 ms 2023-02-09 17:56:33,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:56:33,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e87c0b70dc508223d272183bfbd0aa11 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-09 17:56:33,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/.tmp/info/8039411ec53342f0a6d26b7058425cf6 2023-02-09 17:56:33,194 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 17:56:33,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/.tmp/info/8039411ec53342f0a6d26b7058425cf6 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/info/8039411ec53342f0a6d26b7058425cf6 2023-02-09 17:56:33,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/info/8039411ec53342f0a6d26b7058425cf6, entries=3, sequenceid=7, filesize=4.8 K 2023-02-09 17:56:33,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e87c0b70dc508223d272183bfbd0aa11 in 14ms, sequenceid=7, compaction requested=false 2023-02-09 17:56:33,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/namespace/e87c0b70dc508223d272183bfbd0aa11/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-09 17:56:33,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e87c0b70dc508223d272183bfbd0aa11: Waiting for close lock at 1675965393186Running coprocessor pre-close hooks at 1675965393186Disabling compacts and flushes for region at 1675965393186Disabling writes for close at 1675965393186Obtaining lock to block concurrent updates at 1675965393186Preparing flush snapshotting stores in e87c0b70dc508223d272183bfbd0aa11 at 1675965393186Finished memstore snapshotting hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675965393186Flushing stores of hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. at 1675965393187 (+1 ms)Flushing e87c0b70dc508223d272183bfbd0aa11/info: creating writer at 1675965393187Flushing e87c0b70dc508223d272183bfbd0aa11/info: appending metadata at 1675965393188 (+1 ms)Flushing e87c0b70dc508223d272183bfbd0aa11/info: closing flushed file at 1675965393188Flushing e87c0b70dc508223d272183bfbd0aa11/info: reopening flushed file at 1675965393196 (+8 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e87c0b70dc508223d272183bfbd0aa11 in 14ms, sequenceid=7, compaction requested=false at 1675965393200 (+4 ms)Writing region close event to WAL at 1675965393201 (+1 ms)Running coprocessor post-close hooks at 1675965393203 (+2 ms)Closed at 1675965393204 (+1 ms) 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675965221129.e87c0b70dc508223d272183bfbd0aa11. 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 22c96a7058603f23c359a3e3eedaad85, disabling compactions & flushes 2023-02-09 17:56:33,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. after waiting 0 ms 2023-02-09 17:56:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:56:33,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/22c96a7058603f23c359a3e3eedaad85/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 17:56:33,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 22c96a7058603f23c359a3e3eedaad85: Waiting for close lock at 1675965393204Running coprocessor pre-close hooks at 1675965393204Disabling compacts and flushes for region at 1675965393204Disabling writes for close at 1675965393204Writing region close event to WAL at 1675965393205 (+1 ms)Running coprocessor post-close hooks at 1675965393207 (+2 ms)Closed at 1675965393207 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675965314994.22c96a7058603f23c359a3e3eedaad85. 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a2a95d2d23d1e33829f11de663dbf7e3, disabling compactions & flushes 2023-02-09 17:56:33,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. after waiting 0 ms 2023-02-09 17:56:33,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:56:33,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/a2a95d2d23d1e33829f11de663dbf7e3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a2a95d2d23d1e33829f11de663dbf7e3: Waiting for close lock at 1675965393207Running coprocessor pre-close hooks at 1675965393207Disabling compacts and flushes for region at 1675965393207Disabling writes for close at 1675965393207Writing region close event to WAL at 1675965393208 (+1 ms)Running coprocessor post-close hooks at 1675965393213 (+5 ms)Closed at 1675965393214 (+1 ms) 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675965343833.a2a95d2d23d1e33829f11de663dbf7e3. 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3a1038bc277a0f83bb0fe93be1831eb3, disabling compactions & flushes 2023-02-09 17:56:33,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. after waiting 0 ms 2023-02-09 17:56:33,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:56:33,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/ns/testMinorCompaction/3a1038bc277a0f83bb0fe93be1831eb3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3a1038bc277a0f83bb0fe93be1831eb3: Waiting for close lock at 1675965393214Running coprocessor pre-close hooks at 1675965393214Disabling compacts and flushes for region at 1675965393214Disabling writes for close at 1675965393214Writing region close event to WAL at 1675965393215 (+1 ms)Running coprocessor post-close hooks at 1675965393217 (+2 ms)Closed at 1675965393218 (+1 ms) 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675965343833.3a1038bc277a0f83bb0fe93be1831eb3. 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 54752fc19d09f992050698d1229355c8, disabling compactions & flushes 2023-02-09 17:56:33,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. after waiting 0 ms 2023-02-09 17:56:33,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMinorCompactionWithWeeklyPolicy/54752fc19d09f992050698d1229355c8/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-09 17:56:33,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 54752fc19d09f992050698d1229355c8: Waiting for close lock at 1675965393218Running coprocessor pre-close hooks at 1675965393218Disabling compacts and flushes for region at 1675965393218Disabling writes for close at 1675965393218Writing region close event to WAL at 1675965393219 (+1 ms)Running coprocessor post-close hooks at 1675965393221 (+2 ms)Closed at 1675965393221 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675965250398.54752fc19d09f992050698d1229355c8. 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a146aafefac4ec158955298f90ae2a23, disabling compactions & flushes 2023-02-09 17:56:33,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:56:33,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. after waiting 0 ms 2023-02-09 17:56:33,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a146aafefac4ec158955298f90ae2a23/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 17:56:33,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a146aafefac4ec158955298f90ae2a23: Waiting for close lock at 1675965393221Running coprocessor pre-close hooks at 1675965393221Disabling compacts and flushes for region at 1675965393221Disabling writes for close at 1675965393222 (+1 ms)Writing region close event to WAL at 1675965393222Running coprocessor post-close hooks at 1675965393224 (+2 ms)Closed at 1675965393224 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675965277328.a146aafefac4ec158955298f90ae2a23. 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93ac8ace32e8f3a9264c731189dc6e71, disabling compactions & flushes 2023-02-09 17:56:33,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. after waiting 0 ms 2023-02-09 17:56:33,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/93ac8ace32e8f3a9264c731189dc6e71/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 17:56:33,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93ac8ace32e8f3a9264c731189dc6e71: Waiting for close lock at 1675965393224Running coprocessor pre-close hooks at 1675965393224Disabling compacts and flushes for region at 1675965393224Disabling writes for close at 1675965393224Writing region close event to WAL at 1675965393225 (+1 ms)Running coprocessor post-close hooks at 1675965393227 (+2 ms)Closed at 1675965393227 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675965293929.93ac8ace32e8f3a9264c731189dc6e71. 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 36456c17f39bbdd84b3e92271a1ce067, disabling compactions & flushes 2023-02-09 17:56:33,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. after waiting 0 ms 2023-02-09 17:56:33,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionWithWeeklyPolicy/36456c17f39bbdd84b3e92271a1ce067/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 17:56:33,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 36456c17f39bbdd84b3e92271a1ce067: Waiting for close lock at 1675965393227Running coprocessor pre-close hooks at 1675965393227Disabling compacts and flushes for region at 1675965393227Disabling writes for close at 1675965393227Writing region close event to WAL at 1675965393228 (+1 ms)Running coprocessor post-close hooks at 1675965393230 (+2 ms)Closed at 1675965393230 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675965264035.36456c17f39bbdd84b3e92271a1ce067. 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 927e556cd631a9154b142f09a0d57936, disabling compactions & flushes 2023-02-09 17:56:33,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. after waiting 0 ms 2023-02-09 17:56:33,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:33,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/927e556cd631a9154b142f09a0d57936/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 927e556cd631a9154b142f09a0d57936: Waiting for close lock at 1675965393230Running coprocessor pre-close hooks at 1675965393230Disabling compacts and flushes for region at 1675965393230Disabling writes for close at 1675965393230Writing region close event to WAL at 1675965393231 (+1 ms)Running coprocessor post-close hooks at 1675965393234 (+3 ms)Closed at 1675965393234 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675965372992.927e556cd631a9154b142f09a0d57936. 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b307c18a0ccccb0a839219d40f4730e1, disabling compactions & flushes 2023-02-09 17:56:33,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. after waiting 0 ms 2023-02-09 17:56:33,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:56:33,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testCompactionWithHFileLink/b307c18a0ccccb0a839219d40f4730e1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 17:56:33,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b307c18a0ccccb0a839219d40f4730e1: Waiting for close lock at 1675965393234Running coprocessor pre-close hooks at 1675965393234Disabling compacts and flushes for region at 1675965393234Disabling writes for close at 1675965393234Writing region close event to WAL at 1675965393240 (+6 ms)Running coprocessor post-close hooks at 1675965393243 (+3 ms)Closed at 1675965393243 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675965314994.b307c18a0ccccb0a839219d40f4730e1. 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cebe7f0096a81b1857cdd89be052134d, disabling compactions & flushes 2023-02-09 17:56:33,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. after waiting 0 ms 2023-02-09 17:56:33,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:33,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/default/testMajorCompactionFromAdmin/cebe7f0096a81b1857cdd89be052134d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 17:56:33,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:33,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cebe7f0096a81b1857cdd89be052134d: Waiting for close lock at 1675965393243Running coprocessor pre-close hooks at 1675965393243Disabling compacts and flushes for region at 1675965393243Disabling writes for close at 1675965393243Writing region close event to WAL at 1675965393244 (+1 ms)Running coprocessor post-close hooks at 1675965393246 (+2 ms)Closed at 1675965393246 2023-02-09 17:56:33,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675965372992.cebe7f0096a81b1857cdd89be052134d. 2023-02-09 17:56:33,352 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 17:56:33,552 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 17:56:33,573 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/rep_barrier/00780b4ec2d94789b43bce960318038a 2023-02-09 17:56:33,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00780b4ec2d94789b43bce960318038a 2023-02-09 17:56:33,752 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 17:56:33,765 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 17:56:33,765 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 17:56:33,953 DEBUG [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 17:56:33,965 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 17:56:33,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/table/e6c2f8bfff4149dd9b5378a0c7b1a362 2023-02-09 17:56:33,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c2f8bfff4149dd9b5378a0c7b1a362 2023-02-09 17:56:33,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/info/354b3a4d86094617a02f56d6522b4ffb as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/info/354b3a4d86094617a02f56d6522b4ffb 2023-02-09 17:56:33,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 354b3a4d86094617a02f56d6522b4ffb 2023-02-09 17:56:33,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/info/354b3a4d86094617a02f56d6522b4ffb, entries=226, sequenceid=130, filesize=37.9 K 2023-02-09 17:56:33,993 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/rep_barrier/00780b4ec2d94789b43bce960318038a as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/rep_barrier/00780b4ec2d94789b43bce960318038a 2023-02-09 17:56:33,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00780b4ec2d94789b43bce960318038a 2023-02-09 17:56:33,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/rep_barrier/00780b4ec2d94789b43bce960318038a, entries=1, sequenceid=130, filesize=5.0 K 2023-02-09 17:56:33,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/.tmp/table/e6c2f8bfff4149dd9b5378a0c7b1a362 as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/table/e6c2f8bfff4149dd9b5378a0c7b1a362 2023-02-09 17:56:33,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6c2f8bfff4149dd9b5378a0c7b1a362 2023-02-09 17:56:33,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/table/e6c2f8bfff4149dd9b5378a0c7b1a362, entries=27, sequenceid=130, filesize=6.6 K 2023-02-09 17:56:34,001 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 850ms, sequenceid=130, compaction requested=false 2023-02-09 17:56:34,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-09 17:56:34,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 17:56:34,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 17:56:34,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675965393151Running coprocessor pre-close hooks at 1675965393151Disabling compacts and flushes for region at 1675965393151Disabling writes for close at 1675965393151Obtaining lock to block concurrent updates at 1675965393151Preparing flush snapshotting stores in 1588230740 at 1675965393151Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675965393152 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675965393152Flushing 1588230740/info: creating writer at 1675965393152Flushing 1588230740/info: appending metadata at 1675965393156 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675965393156Flushing 1588230740/rep_barrier: creating writer at 1675965393166 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675965393168 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675965393168Flushing 1588230740/table: creating writer at 1675965393578 (+410 ms)Flushing 1588230740/table: appending metadata at 1675965393580 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675965393580Flushing 1588230740/info: reopening flushed file at 1675965393989 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675965393993 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675965393996 (+3 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 850ms, sequenceid=130, compaction requested=false at 1675965394001 (+5 ms)Writing region close event to WAL at 1675965394003 (+2 ms)Running coprocessor post-close hooks at 1675965394005 (+2 ms)Closed at 1675965394005 2023-02-09 17:56:34,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 17:56:34,153 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42581,1675965218218; all regions closed. 2023-02-09 17:56:34,160 DEBUG [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/oldWALs 2023-02-09 17:56:34,160 INFO [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42581%2C1675965218218.meta:.meta(num 1675965220888) 2023-02-09 17:56:34,164 DEBUG [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/oldWALs 2023-02-09 17:56:34,164 INFO [RS:0;jenkins-hbase4:42581] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42581%2C1675965218218:(num 1675965219916) 2023-02-09 17:56:34,164 DEBUG [RS:0;jenkins-hbase4:42581] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:34,164 INFO [RS:0;jenkins-hbase4:42581] regionserver.LeaseManager(133): Closed leases 2023-02-09 17:56:34,164 INFO [RS:0;jenkins-hbase4:42581] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 17:56:34,164 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 17:56:34,165 INFO [RS:0;jenkins-hbase4:42581] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42581 2023-02-09 17:56:34,173 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 17:56:34,173 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42581,1675965218218 2023-02-09 17:56:34,173 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7efa80f2 rejected from java.util.concurrent.ThreadPoolExecutor@7ac50bf5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,173 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 17:56:34,173 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24e5fcfc rejected from java.util.concurrent.ThreadPoolExecutor@7ac50bf5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,176 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42581,1675965218218] 2023-02-09 17:56:34,176 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42581,1675965218218; numProcessing=1 2023-02-09 17:56:34,178 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42581,1675965218218 already deleted, retry=false 2023-02-09 17:56:34,178 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42581,1675965218218 expired; onlineServers=0 2023-02-09 17:56:34,178 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37293,1675965217092' ***** 2023-02-09 17:56:34,178 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 17:56:34,178 DEBUG [M:0;jenkins-hbase4:37293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5399665, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 17:56:34,178 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37293,1675965217092 2023-02-09 17:56:34,178 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37293,1675965217092; all regions closed. 2023-02-09 17:56:34,178 DEBUG [M:0;jenkins-hbase4:37293] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 17:56:34,178 DEBUG [M:0;jenkins-hbase4:37293] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 17:56:34,179 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 17:56:34,179 DEBUG [M:0;jenkins-hbase4:37293] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 17:56:34,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675965219633] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675965219633,5,FailOnTimeoutGroup] 2023-02-09 17:56:34,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675965219633] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675965219633,5,FailOnTimeoutGroup] 2023-02-09 17:56:34,179 INFO [M:0;jenkins-hbase4:37293] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 17:56:34,179 INFO [M:0;jenkins-hbase4:37293] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 17:56:34,179 INFO [M:0;jenkins-hbase4:37293] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 17:56:34,179 DEBUG [M:0;jenkins-hbase4:37293] master.HMaster(1502): Stopping service threads 2023-02-09 17:56:34,180 INFO [M:0;jenkins-hbase4:37293] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 17:56:34,180 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 17:56:34,180 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 17:56:34,180 ERROR [M:0;jenkins-hbase4:37293] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-09 17:56:34,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 17:56:34,181 INFO [M:0;jenkins-hbase4:37293] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 17:56:34,181 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 17:56:34,181 DEBUG [M:0;jenkins-hbase4:37293] zookeeper.ZKUtil(398): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 17:56:34,181 WARN [M:0;jenkins-hbase4:37293] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 17:56:34,181 INFO [M:0;jenkins-hbase4:37293] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 17:56:34,181 INFO [M:0;jenkins-hbase4:37293] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 17:56:34,181 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 17:56:34,181 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:56:34,181 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:56:34,181 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 17:56:34,181 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:56:34,181 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.50 KB heapSize=598.24 KB 2023-02-09 17:56:34,276 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 17:56:34,276 INFO [RS:0;jenkins-hbase4:42581] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42581,1675965218218; zookeeper connection closed. 2023-02-09 17:56:34,276 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c7a3d02 rejected from java.util.concurrent.ThreadPoolExecutor@7ac50bf5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,277 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): regionserver:42581-0x1003a379fc60001, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 17:56:34,277 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54e1709b rejected from java.util.concurrent.ThreadPoolExecutor@7ac50bf5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,277 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@78aa6396] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@78aa6396 2023-02-09 17:56:34,277 INFO [Listener at localhost/44673] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-09 17:56:34,589 INFO [M:0;jenkins-hbase4:37293] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.50 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/06df888d7ed449499f07e475ebfe967b 2023-02-09 17:56:34,592 INFO [M:0;jenkins-hbase4:37293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06df888d7ed449499f07e475ebfe967b 2023-02-09 17:56:34,593 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/06df888d7ed449499f07e475ebfe967b as hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/06df888d7ed449499f07e475ebfe967b 2023-02-09 17:56:34,596 INFO [M:0;jenkins-hbase4:37293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06df888d7ed449499f07e475ebfe967b 2023-02-09 17:56:34,596 INFO [M:0;jenkins-hbase4:37293] regionserver.HStore(1080): Added hdfs://localhost:41421/user/jenkins/test-data/b59e7b96-b2c7-56c2-4ffc-f0412ed5d3f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/06df888d7ed449499f07e475ebfe967b, entries=123, sequenceid=1005, filesize=33.3 K 2023-02-09 17:56:34,597 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegion(2947): Finished flush of dataSize ~512.50 KB/524798, heapSize ~598.23 KB/612584, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1005, compaction requested=false 2023-02-09 17:56:34,597 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 17:56:34,598 DEBUG [M:0;jenkins-hbase4:37293] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675965394181Disabling compacts and flushes for region at 1675965394181Disabling writes for close at 1675965394181Obtaining lock to block concurrent updates at 1675965394181Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675965394181Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=524798, getHeapSize=612584, getOffHeapSize=0, getCellsCount=1160 at 1675965394182 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675965394182Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675965394182Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675965394185 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675965394185Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675965394594 (+409 ms)Finished flush of dataSize ~512.50 KB/524798, heapSize ~598.23 KB/612584, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1005, compaction requested=false at 1675965394597 (+3 ms)Writing region close event to WAL at 1675965394597Closed at 1675965394597 2023-02-09 17:56:34,600 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 17:56:34,600 INFO [M:0;jenkins-hbase4:37293] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 17:56:34,601 INFO [M:0;jenkins-hbase4:37293] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37293 2023-02-09 17:56:34,603 DEBUG [M:0;jenkins-hbase4:37293] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37293,1675965217092 already deleted, retry=false 2023-02-09 17:56:34,705 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 17:56:34,705 INFO [M:0;jenkins-hbase4:37293] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37293,1675965217092; zookeeper connection closed. 2023-02-09 17:56:34,705 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@787d1def rejected from java.util.concurrent.ThreadPoolExecutor@12be896d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,706 DEBUG [Listener at localhost/44673-EventThread] zookeeper.ZKWatcher(600): master:37293-0x1003a379fc60000, quorum=127.0.0.1:59572, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 17:56:34,706 ERROR [Listener at localhost/44673-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7fab74ab rejected from java.util.concurrent.ThreadPoolExecutor@12be896d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 17:56:34,707 WARN [Listener at localhost/44673] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 17:56:34,710 INFO [Listener at localhost/44673] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 17:56:34,818 WARN [BP-2080551098-172.31.14.131-1675965213977 heartbeating to localhost/127.0.0.1:41421] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 17:56:34,818 WARN [BP-2080551098-172.31.14.131-1675965213977 heartbeating to localhost/127.0.0.1:41421] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2080551098-172.31.14.131-1675965213977 (Datanode Uuid 83933e6b-e6c2-4b42-a43d-01ae705447a4) service to localhost/127.0.0.1:41421 2023-02-09 17:56:34,820 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/dfs/data/data1/current/BP-2080551098-172.31.14.131-1675965213977] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 17:56:34,821 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4281586b-95b2-b0a1-cd3b-b90dc174f457/cluster_acfe773f-3e11-9ac4-ae1f-36980a140eb0/dfs/data/data2/current/BP-2080551098-172.31.14.131-1675965213977] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 17:56:34,845 INFO [Listener at localhost/44673] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 17:56:34,980 INFO [Listener at localhost/44673] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 17:56:35,077 INFO [Listener at localhost/44673] hbase.HBaseTestingUtility(1293): Minicluster is down